Collection of HHC programming contests and other useful documents - Printable Version +- HP Forums (https://www.hpmuseum.org/forum) +-- Forum: HP Calculators (and very old HP Computers) (/forum-3.html) +--- Forum: General Forum (/forum-4.html) +--- Thread: Collection of HHC programming contests and other useful documents (/thread-9090.html) |
RE: Collection of HHC programming contests and other useful documents - pier4r - 02-06-2018 08:06 PM Any suggestion on what to include for the february update? Although with Eric torrents we have most of the stuff online available via p2p. Still there may be sites, documents, discussions, etc... that are worth saving. RE: Collection of HHC programming contests and other useful documents - pier4r - 02-16-2018 06:00 PM I renew the question about suggestions. Although the topic "digits of pi" had quite some nice links that I have to check. Interesting how such constants are always a goldmine of interesting reads. In the meanwhile an observation. Although the hpcalc.org main torrent surely has stronger seeders than me, and the hp_calc_torrent has mostly only me, the stats of qbittorrent tells me that: hpcalc.org main torrent is shared since 21 days, and I uploaded 7.46 gb. the hp_calc_torrent base is shared since 70 days, and I uploaded 4.5 gb. The hp41 dvd torrent -another one with strong seeders - is shared since 90+ days, and I uploaded 13 gb. I cannot imagine how active are the hpcalc.org torrent and the hp41 dvd torrent, since I alone have already shared a lot, the strong seeders shared surely more! As expected, over time the torrents with a lot of quality shows interest although one should not expect to see traffic like the last popular freemium game. RE: Collection of HHC programming contests and other useful documents - pier4r - 02-23-2018 02:48 PM update 201802 magnet:?xt=urn:btih:e571cf926d210a1ebf1f0299d6c5cd8d2daede99&dn=hp_calc_torrent_u201802 All the info: first post -> http://www.hpmuseum.org/forum/thread-9090.html As usual, suggestions about what to include and the rest are welcomed. Code:
RE: Collection of HHC programming contests and other useful documents - pier4r - 04-02-2018 01:52 PM update 201803 magnet:?xt=urn:btih:b1e223e84f05b433807bff5e772dd2dc4a48d04b&dn=hp_calc_torrent_u201803 All the info: first post -> http://www.hpmuseum.org/forum/thread-9090.html As usual, suggestions about what to include and the rest are welcomed. Code:
RE: Collection of HHC programming contests and other useful documents - pier4r - 05-11-2018 07:36 PM update 201804 magnet:?xt=urn:btih:f66b0ab0e9cd003554d209abc40edc183acb30a8&dn=hp_calc_torrent_u201804 All the info: first post -> http://www.hpmuseum.org/forum/thread-9090.html As usual, suggestions about what to include and the rest are welcomed. Code:
RE: Collection of HHC programming contests and other useful documents - pier4r - 05-20-2018 11:28 AM update 201805 magnet:?xt=urn:btih:c67a2cb68316f97fc30e97d7da9a97974fd7cf3c&dn=hp_calc_torrent_u201805 All the info: first post -> http://www.hpmuseum.org/forum/thread-9090.html As usual, suggestions about what to include and the rest are welcomed. Early release this time as I tried to collect very slowly to avoid side effects (over 20 days, 1 request each 30 seconds) some of the public discussions of this myBB forum (until thread 10720, but threads can be updated). This due to the recent losses that stimulate me to act. Of course they cannot beat a forum dump, but better than nothing. The content, I think, can be greatly improved, but as in many things, one has to start. The collection tried to get only the links mentioned in the available discussions. For example there are a lot of youtube pages (each around 190kb or so) that are partly useless, but if one searches for the youtube video identifier, it works. I tried and I got a hhc 2011 nice video from Namir that tested the 15C vs the 15 Limited edition (of course, thanks to all the people that helped having that video online). Many files are html files but they have no extension to match the URI and avoid redownloads. There may be replicated content with other torrents, but once again, better twice than not at all. The release is pretty big and my bandwidth is not that strong, so if you get it you need to wait. Also, if I find the time, the next month I will release a new major update. That is, merging the updates in one single torrent (that will be huge, 5+ GB) and slowly taking away the previous torrents (aside from other seeders being available) Code:
RE: Collection of HHC programming contests and other useful documents - Eric Rechlin - 05-22-2018 02:34 PM (05-20-2018 11:28 AM)pier4r Wrote: Early release this time as I tried to collect very slowly to avoid side effects (over 20 days, 1 request each 30 seconds) some of the public discussions of this myBB forum (until thread 10720, but threads can be updated). This due to the recent losses that stimulate me to act. Of course they cannot beat a forum dump, but better than nothing. I just spent the last 13 days downloading the archives of the old forum (at a similarly slow rate so as not to put undue load on the server). It looks like there were around 175,000 posts retrieved; because the sequence numbers go to around 258,000 I'm not sure if I missed some or if there are just that many gaps in the sequence. I still have a lot of work to do on it (I will eventually write some code to refactor the site in an automated manner to make it more usable), but I believe I have all threads and all Museum-hosted images from those threads. I will probably make a second pass later to attempt to get remotely hosted images as well, before any more image hosting sites shut down. RE: Collection of HHC programming contests and other useful documents - anderin - 05-22-2018 08:56 PM Great work pier4r!!! Thanks!!! RE: Collection of HHC programming contests and other useful documents - pier4r - 06-23-2018 09:09 AM You are welcome. For June I planned the big merge but I am not finding the time. I have a relatively intense simulation running on the 50g plus user RPL (not even that optimized) and the time between runs is at least 2 days. I have so little time that 2 days are still faster than my processing speed. Therefore, once again, suggestions are welcomed as I often don't have the possibility to process what is still available in the internet public domain. RE: Collection of HHC programming contests and other useful documents - rprosperi - 07-15-2018 06:21 PM Pier, I tried to download the 3 latest torrents today with mixed results: hp_calc_torrent_u201803: Could not connect, even after > 1 hour, so it appears this is no longer being seeded at all. hp_calc_torrent_u201804: Download OK hp_calc_torrent_u201805: I bailed-out after realizing the size and content. Though it's good someone will archive this, I've no need for it. Suggestion: When you do merge the prior torrents into a single large one, I suggest you leave the MoHPC myBB Forum contents as a separate pkg, as the size is huge (=takes days) and of generally less interest to most folks (at least IMHO) and if they want it, they can still get it. And no rush on preparing and sharing the merged version, I'm just commenting while it's all fresh. And of course, my thanks again for doing this for the community. RE: Collection of HHC programming contests and other useful documents - pier4r - 07-15-2018 10:01 PM Thanks for the feedback. I'm really having no time recently . Also I got a bump by the ISP (no more fair share use). So I could try to push the bandwidth a bit. I hope to try to find time this week. As usual suggestions about what to include are welcomed! RE: Collection of HHC programming contests and other useful documents - pier4r - 07-20-2018 08:10 PM Some time found, not yet enough but good for some steps. (07-15-2018 06:21 PM)rprosperi Wrote: hp_calc_torrent_u201803: Could not connect, even after > 1 hour, so it appears this is no longer being seeded at all.On my side it is ok. magnet:?xt=urn:btih:b1e223e84f05b433807bff5e772dd2dc4a48d04b&dn=hp_calc_torrent_u201803 Quote:hp_calc_torrent_u201804: Download OK yes the 201805 is massive and I expect it is missing a lot (surely all the attachments in the forum). If everything went well at least 40-50% of the text was saved. Note that with the torrent one can decide what to download, one can decide to download only some subfolders instead of all of them. It is still something. Updated the upload speed from 24 kB/s to 100 kB/s (less than a day to download the entire 6.5 gb , I am assuming it is feasible with devices left 8 hours per day for 3 days open. I am leaving mine 24/7 open) . I am not sure whether it is ok for me (I had to limit things before for several reasons, one of which: the capped bandwidth usage per month) we will see. Once again the advantage of torrent over other more democratic p2p networks (see emule) is that one can download the metadata and then cherry pick the content. For example I don't know why but in the HP41-DVD there are some "hidden" files, namely ".DS_store" left there and there that break qbittorrent. I deselected them and it is all fine. No yet time for the huge merge and as usual, if someone has suggestions (even something like "I saw this thread/resource, would it be possible to back it up?") please share! RE: Collection of HHC programming contests and other useful documents - rprosperi - 07-20-2018 08:21 PM (07-20-2018 08:10 PM)pier4r Wrote:(07-15-2018 06:21 PM)rprosperi Wrote: hp_calc_torrent_u201803: Could not connect, even after > 1 hour, so it appears this is no longer being seeded at all.On my side it is ok. It appears something has changed, as trying it again just now, it connected immediately and is happily downloading now. Thanks again Pier. RE: Collection of HHC programming contests and other useful documents - pier4r - 07-20-2018 08:50 PM (07-20-2018 08:21 PM)rprosperi Wrote: It appears something has changed, as trying it again just now, it connected immediately and is happily downloading now. Sometimes my home server chokes on itself. It is already 12 years old (I am waiting that it dies, it will outlast me) and for me it takes time to notice as I have no monitoring around. Most of my homelab is relatively old (the gateways are ~10 year old), and I am happy as I am running the components into the grave as it should be done for whatever resource that works. RE: Collection of HHC programming contests and other useful documents - pier4r - 08-05-2018 11:18 AM Merged the base! Now it is almost 4.5 gigabytes. The files are in the first post. magnet:?xt=urn:btih:770671f54d5492644b24ae0080c0156b982a5e47&dn=hp_calc_torrent All the info: first post -> http://www.hpmuseum.org/forum/thread-9090.html As usual, suggestions about what to include and the rest are welcomed. Code:
RE: Collection of HHC programming contests and other useful documents - rprosperi - 08-05-2018 01:21 PM Thanks for the update pier4r. RE: Collection of HHC programming contests and other useful documents - Eric Rechlin - 09-22-2018 07:15 PM I finally got a chance to go through pier4r's 201805 torrent, which has a scraped copy of this current HP Museum Forum through May. It's a really good start. I wrote some code similar to what I wrote for the old forum, to parse all the messages to make an offline download. Unlike pier4r's torrent, I didn't try to capture all linked content, but just the embedded content. This reduced its size somewhat. Also, similar to what I did for the old forum, I went through all broken links in an attempt to find any missing images and restore them, either from the Wayback Machine or by contacting the authors. I also grabbed close to 200 of the embedded images that were classified as attachments and therefore required a login to view. As before, I have attached a list of all the images I was unable to restore. This time I also listed the thread number of each one missing images, too. Unfortunately, I noticed that the snapshot that pier4r made used the "printthread" version of everything. This loses some information, most notably all the individual post numbers, but also any attachments (probably thousands of files) and some other minor things. By passing a forum login cookie into the download process, it can then pull all the attachments also. At some point I will download the whole new forum myself, this time using a login cookie and pulling the full version of the posts rather than the "printthread" version. Doing this would also produce something feasible for loading into my own MyBB instance, should the HP Museum site ever shut down. But for now, what pier4r did was good enough. And as long as Dave keeps maintaining the HP Museum Forum I see little reason to create an online-viewable mirrored version of it. In the interest of preserving the historic record, I've now posted a torrent with my processed version of his torrent here. This is completely usable offline, though navigating between messages without using the menus can be difficult due to the lost message hierarchy. All messages are browsable in the same manner as the offline version I made of the old museum, as well as the other discussion forums and newsgroups that I have torrents for. It has all posts through May 19, 2018, plus around 93% of the embedded images. Also at this time, all subforums are combined into a single menu, though each post indicates the forum it came from. I might consider breaking up the separate forums at some point. Screenshot of menu: Download from here: https://www.hpcalc.org/torrents/ RE: Collection of HHC programming contests and other useful documents - pier4r - 09-22-2018 07:46 PM And Eric delivers more awesomeness! I am happy someone went through my attempt and found out that was not as broken as I imagined (I set an expectation to about 25% of the contents, more is gold surplus) and even processed it. Happy to help. Now I am going to share also your new torrent. As an info in terms of uploaded GBs I have at the moment the following. My attempt to make an archive to the MyBB forum (update 201805): 20.69 GB uploaded. hpcalc.org torrent from early 2018: 17.94 GB uploaded. Hp41 dvd. 14.67 GB uploaded (plus some 11 or 12 GB before I relocated it and qbittorrent didn't like it. So like 25GB in total). my hp calc torrent (see first page): 8.3 GB, but that is from September, without considering all the previous uploads. Comp.sys.hp48 from eric. 0.5 GB comp.sys.handhelds. 100 MB. listserv.nodak.edu 12 MB. I have a possible update for September, but as usual feel free to make suggestions! RE: Collection of HHC programming contests and other useful documents - Eric Rechlin - 09-22-2018 09:57 PM I suppose some stats on what I've uploaded for the torrents could be interesting too, rounded to the nearest 0.1 GB: comp.sys.handhelds: 0.5 GB comp.sys.hp48 2018-01-01: 1.0 GB HP Emulators: 7.0 GB HP Learning Modules: 1.2 GB HP Museum Forum Archive: 2.6 GB HP Photos: 4.0 GB HP Slides: 4.6 GB HP Solve: 1.7 GB HP-41 DVD: 338.0 GB 201808 torrent: 0.0 GB 201805 torrent: 3.5 GB hpcalc.org 2018-01-01: 100.0 GB listserv.nodak.edu: 0.0 GB Teenix Emulators: 2.8 GB RE: Collection of HHC programming contests and other useful documents - pier4r - 09-22-2018 11:12 PM I remember when you said "no one is interested" and after less than a year, 100GB uploaded (and I could contribute with almost 18 GB). Nice! For such small community, it is quite something. |