Collection of HHC programming contests and other useful documents

[pier4r]

Any suggestion on what to include for the february update?

Although with Eric torrents we have most of the stuff online available via p2p. Still there may be sites, documents, discussions, etc... that are worth saving.

[pier4r]

I renew the question about suggestions. Although the topic "digits of pi" had quite some nice links that I have to check. Interesting how such constants are always a goldmine of interesting reads.

In the meanwhile an observation. Although the hpcalc.org main torrent surely has stronger seeders than me, and the hp_calc_torrent has mostly only me, the stats of qbittorrent tells me that:

hpcalc.org main torrent is shared since 21 days, and I uploaded 7.46 gb.
the hp_calc_torrent base is shared since 70 days, and I uploaded 4.5 gb.
The hp41 dvd torrent -another one with strong seeders - is shared since 90+ days, and I uploaded 13 gb.

I cannot imagine how active are the hpcalc.org torrent and the hp41 dvd torrent, since I alone have already shared a lot, the strong seeders shared surely more!

As expected, over time the torrents with a lot of quality shows interest although one should not expect to see traffic like the last popular freemium game.

[pier4r]

update 201802
magnet:?xt=urn:btih:e571cf926d210a1ebf1f0299d6c5cd8d2daede99&dn=hp_calc_torrent_u201802

All the info: first post -> http://www.hpmuseum.org/forum/thread-9090.html

As usual, suggestions about what to include and the rest are welcomed.

Code:


- 2018-02-23
  u201802
  - added
    . documents from this thread: http://www.hpmuseum.org/forum/thread-10108.html
    . documents from http://www.hpmuseum.org/forum/thread-10166.html
    . listExt for 50g. http://www.hpmuseum.org/forum/thread-8555.html
  - notes
    . nice link http://pi314.net/eng/programmes.php#calculatrices
    . Hmm, I want to save documents from a couple of threads, but I remember only one.
      I remember, though, that they are in the hpmuseum.org forum. It does not help though,
      since there are thousand of threads and having a filtered selection is not bad.
      I hope to find them (and bookmark them) the next time.
- 2018-02-17
  - notes
    . more tests on the search string (to find interesting threads, at least for me
      at the moment)
      site:hpmuseum.org challenge OR contest OR puzzle OR pi OR constant
      
      I would really like to have an "and" version. Like.
      site:hpmuseum.org challenge OR contest OR puzzle OR pi OR constant OR (math AND problem)
      but google does not allow it yet.
      
      Actually instead of "constant" one could use digits or pi. The amount of interesting
      info shared while playing around with PI is outstanding.
      Nonetheless I tried to be generic with constant, because PI gets only PI...
      ...no wait a minute. The likelyhood that PI will be mentioned in any interesting
      thread about math is pretty high (although not 100%) so it may work better
      than "constant" that collides with "constant memory".
      
      "Problem" alone brings up a lot of real problem, not math problems.
      
      Ok but a math problem may have answers or solutions, so what about the following?
      site:hpmuseum.org challenge OR contest OR puzzle OR pi OR constant OR solution OR answer
      
      We are in 2018 and still we have to play the detectives with automated tools
      instead of having proper query syntax (that is already present in other
      context, like databases).
      
      Anyway a search like the above produces 8950 results but actually only 55 pages.
      (so 550 results).
      
      With such a little number of pages one can slowly go through the search
      randomly (using a random function of a calculator). The alternative is to build
      a better search engine for the target domain. Since google, bing and others
      may be powerful, but when they don't crawl properly some target domains
      they may be surpassed by other ad hoc solutions.
      
- 2018-02-07
  - notes
    . search string on search engines similar to one previously mentioned: 
      site:hpmuseum.org problem OR challenge OR puzzle OR math OR contest OR exercise
    . at least for a certain point in time, the great Eric of hpcalc.org solved
      the following todos:
      * include a snapshot of hpcalc.org
      * include a snapshot of the comp.sys.hp48 newsgroup
      See: https://www.hpcalc.org/torrents/
- 2018-01-29
  u201801
  - added
    . some books mentioned in forum threads.
    . a document about the 35s
    . documents and files about the hp prime.
  - notes
    . the amazing eric released a lot of super worthwile data in p2p format! 
      About hpcalc.org and discussion forums.
      I wish every community (for example casio/ti) would do the same!
      check them here! https://www.hpcalc.org/torrents/
    . no progress in collecting quite general purpose userRPL code :/

[pier4r]

update 201803
magnet:?xt=urn:btih:b1e223e84f05b433807bff5e772dd2dc4a48d04b&dn=hp_calc_torrent_u201803

All the info: first post -> http://www.hpmuseum.org/forum/thread-9090.html

As usual, suggestions about what to include and the rest are welcomed.

Code:


- 2018-04-02
  u201803
  - notes
    . releasing the new update, not much improvements since the last entries.
      If the community doesn't help it is highly unlikely to collect what is
      still reachable online and worth to save. (worth: for at least one person
      is worth)
      I, pier4r, alone can do really a little, although better than nothing.
      I myself realize such activities quite late. This should have been started
      years ago, not in 2018. Although, as said, better starting in 2018
      than in twothousandnever (that is, never). As we may end up collecting
      1% of what we could. But if we never start, we are fixed at 0. Plus one
      has still other "librarians". hpcalc.org, *****, hpmuseum.org document set
      and maybe others.
      Slowly, slowly we can shrink the gap a little bit.
      The goal is not 100%, rather improving or not being worse compared to the yesterday.
- 2018-03-25
  - notes
    . finding RPL commands is pretty hard. There are plenty already on the
      MoHPC, but without precise keywords, no chances.
      And even with good keywords, it depends on how much the site is
      indexed by the search engine.
      A possible search site:hpmuseum.org "<<"
      as the << are often mentioned in ascii to open a user RPL program.
      or the more generic
      site:hpmuseum.org rpl 
      (since userRPL, sysRPL, uRPL, sRPL , user RPL etc..
      contains RPL)
- 2018-03-15
  - added
    . some documents found after searching for the info about the PDQ progran of Joe Horn
      That brought me to http://holyjoe.org/hp/flashback.htm
      http://holyjoe.org/hp/flash18.txt
      and http://zuse.zib.de/pdfs
      (and I want to improve my poor German. Worst case, google translate, since we are in 2018)
    . some more hp journals issues about calculators.
    . hp 50g documents about community made contributions.
- 2018-03-11
  - added
    . Documents from: http://www.hpmuseum.org/forum/thread-7687.html
      decimal basic. http://hp.vector.co.jp/authors/VA008683/english/
    . a user suggested the hp measure journal, and I found interesting
      to download all the issues that I could spot talking about
      calculators. If I miss some, please include them.
      http://www.hp.com/hpinfo/abouthp/histnfacts/publications/measure/
      http://www.hpmuseum.org/forum/thread-10304.html
- 2018-03-09
  - notes
    . userRPL collection superseeded here:
      http://www.hpmuseum.org/forum/thread-10271.html
- 2018-02-25
  - possible interesting links (ed2k links, one needs to use an ed2k compatible client
    the ed2k network is super for sharing rare infomation over time)
    -cut-

[pier4r]

update 201804
magnet:?xt=urn:btih:f66b0ab0e9cd003554d209abc40edc183acb30a8&dn=hp_calc_torrent_u201804

All the info: first post -> http://www.hpmuseum.org/forum/thread-9090.html

As usual, suggestions about what to include and the rest are welcomed.

Code:


- 2018-05-11
  u201804
  - notes
    . a late release. I should master some automated procedures to download interesting
      content linked from the forum instead of perusing it manually. As manually
      I often don't have time for it. And of course, suggestions are welcomed!
- 2018-04-21
  - added
    . some documents mentioned in discussions. Different discussions, mostly math
      that can be implemented in calculators.

[pier4r]

update 201805
magnet:?xt=urn:btih:c67a2cb68316f97fc30e97d7da9a97974fd7cf3c&dn=hp_calc_torrent_u201805

All the info: first post -> http://www.hpmuseum.org/forum/thread-9090.html

As usual, suggestions about what to include and the rest are welcomed.

Early release this time as I tried to collect very slowly to avoid side effects (over 20 days, 1 request each 30 seconds) some of the public discussions of this myBB forum (until thread 10720, but threads can be updated). This due to the recent losses that stimulate me to act. Of course they cannot beat a forum dump, but better than nothing.

The content, I think, can be greatly improved, but as in many things, one has to start. The collection tried to get only the links mentioned in the available discussions. For example there are a lot of youtube pages (each around 190kb or so) that are partly useless, but if one searches for the youtube video identifier, it works. I tried and I got a hhc 2011 nice video from Namir that tested the 15C vs the 15 Limited edition (of course, thanks to all the people that helped having that video online).

Many files are html files but they have no extension to match the URI and avoid redownloads.
There may be replicated content with other torrents, but once again, better twice than not at all.

The release is pretty big and my bandwidth is not that strong, so if you get it you need to wait.
Also, if I find the time, the next month I will release a new major update. That is, merging the updates in one single torrent (that will be huge, 5+ GB) and slowly taking away the previous torrents (aside from other seeders being available)

Code:


-

[Eric Rechlin]

(05-20-2018 11:28 AM)pier4r Wrote:  Early release this time as I tried to collect very slowly to avoid side effects (over 20 days, 1 request each 30 seconds) some of the public discussions of this myBB forum (until thread 10720, but threads can be updated). This due to the recent losses that stimulate me to act. Of course they cannot beat a forum dump, but better than nothing.

I just spent the last 13 days downloading the archives of the old forum (at a similarly slow rate so as not to put undue load on the server). It looks like there were around 175,000 posts retrieved; because the sequence numbers go to around 258,000 I'm not sure if I missed some or if there are just that many gaps in the sequence.

I still have a lot of work to do on it (I will eventually write some code to refactor the site in an automated manner to make it more usable), but I believe I have all threads and all Museum-hosted images from those threads. I will probably make a second pass later to attempt to get remotely hosted images as well, before any more image hosting sites shut down.

[anderin]

Great work pier4r!!!
Thanks!!!

[pier4r]

You are welcome. For June I planned the big merge but I am not finding the time.

I have a relatively intense simulation running on the 50g plus user RPL (not even that optimized) and the time between runs is at least 2 days. I have so little time that 2 days are still faster than my processing speed.

Therefore, once again, suggestions are welcomed as I often don't have the possibility to process what is still available in the internet public domain.

[rprosperi]

Pier,

I tried to download the 3 latest torrents today with mixed results:

hp_calc_torrent_u201803: Could not connect, even after > 1 hour, so it appears this is no longer being seeded at all.

hp_calc_torrent_u201804: Download OK

hp_calc_torrent_u201805: I bailed-out after realizing the size and content. Though it's good someone will archive this, I've no need for it.

Suggestion: When you do merge the prior torrents into a single large one, I suggest you leave the MoHPC myBB Forum contents as a separate pkg, as the size is huge (=takes days) and of generally less interest to most folks (at least IMHO) and if they want it, they can still get it.

And no rush on preparing and sharing the merged version, I'm just commenting while it's all fresh.

And of course, my thanks again for doing this for the community.

[pier4r]

Thanks for the feedback. I'm really having no time recently . Also I got a bump by the ISP (no more fair share use). So I could try to push the bandwidth a bit.

I hope to try to find time this week.

As usual suggestions about what to include are welcomed!

[pier4r]

Some time found, not yet enough but good for some steps.

(07-15-2018 06:21 PM)rprosperi Wrote:  hp_calc_torrent_u201803: Could not connect, even after > 1 hour, so it appears this is no longer being seeded at all.

On my side it is ok.
magnet:?xt=urn:btih:b1e223e84f05b433807bff5e772dd2dc4a48d04b&dn=hp_calc_torrent_u201803

Quote:hp_calc_torrent_u201804: Download OK

hp_calc_torrent_u201805: I bailed-out after realizing the size and content. Though it's good someone will archive this, I've no need for it.

yes the 201805 is massive and I expect it is missing a lot (surely all the attachments in the forum). If everything went well at least 40-50% of the text was saved.

Note that with the torrent one can decide what to download, one can decide to download only some subfolders instead of all of them. It is still something.

Updated the upload speed from 24 kB/s to 100 kB/s (less than a day to download the entire 6.5 gb , I am assuming it is feasible with devices left 8 hours per day for 3 days open. I am leaving mine 24/7 open) . I am not sure whether it is ok for me (I had to limit things before for several reasons, one of which: the capped bandwidth usage per month) we will see.

Once again the advantage of torrent over other more democratic p2p networks (see emule) is that one can download the metadata and then cherry pick the content.

For example I don't know why but in the HP41-DVD there are some "hidden" files, namely ".DS_store" left there and there that break qbittorrent. I deselected them and it is all fine.

No yet time for the huge merge and as usual, if someone has suggestions (even something like "I saw this thread/resource, would it be possible to back it up?") please share!

[rprosperi]

(07-20-2018 08:10 PM)pier4r Wrote:  

(07-15-2018 06:21 PM)rprosperi Wrote:  hp_calc_torrent_u201803: Could not connect, even after > 1 hour, so it appears this is no longer being seeded at all.

On my side it is ok.
magnet:?xt=urn:btih:b1e223e84f05b433807bff5e772dd2dc4a48d04b&dn=hp_calc_torrent_u201803

It appears something has changed, as trying it again just now, it connected immediately and is happily downloading now.

Thanks again Pier.

[pier4r]

(07-20-2018 08:21 PM)rprosperi Wrote:  It appears something has changed, as trying it again just now, it connected immediately and is happily downloading now.

Thanks again Pier.

Sometimes my home server chokes on itself. It is already 12 years old (I am waiting that it dies, it will outlast me) and for me it takes time to notice as I have no monitoring around. Most of my homelab is relatively old (the gateways are ~10 year old), and I am happy as I am running the components into the grave as it should be done for whatever resource that works.

[pier4r]

Merged the base! Now it is almost 4.5 gigabytes. The files are in the first post.

magnet:?xt=urn:btih:770671f54d5492644b24ae0080c0156b982a5e47&dn=hp_calc_torrent

All the info: first post -> http://www.hpmuseum.org/forum/thread-9090.html

As usual, suggestions about what to include and the rest are welcomed.

Code:


- 2018-08-05
  new general torrent relaase aside from the u201805 that is massive, it will be
  merged later.
  - notes
    . all the u201712, u201801, u201802, u201803, u201804 are merged in the hpcalc torrent
    . yes I didn't have time to produce releases since May. Life happens.
    . although the community didn't suggest anything to add until today with the learning
      modules. http://www.hpmuseum.org/forum/thread-11170.html

[/quote]

[rprosperi]

Thanks for the update pier4r.

[Eric Rechlin]

I finally got a chance to go through pier4r's 201805 torrent, which has a scraped copy of this current HP Museum Forum through May.

It's a really good start.

I wrote some code similar to what I wrote for the old forum, to parse all the messages to make an offline download. Unlike pier4r's torrent, I didn't try to capture all linked content, but just the embedded content. This reduced its size somewhat. Also, similar to what I did for the old forum, I went through all broken links in an attempt to find any missing images and restore them, either from the Wayback Machine or by contacting the authors. I also grabbed close to 200 of the embedded images that were classified as attachments and therefore required a login to view.

As before, I have attached a list of all the images I was unable to restore. This time I also listed the thread number of each one missing images, too.

Unfortunately, I noticed that the snapshot that pier4r made used the "printthread" version of everything. This loses some information, most notably all the individual post numbers, but also any attachments (probably thousands of files) and some other minor things. By passing a forum login cookie into the download process, it can then pull all the attachments also.

At some point I will download the whole new forum myself, this time using a login cookie and pulling the full version of the posts rather than the "printthread" version. Doing this would also produce something feasible for loading into my own MyBB instance, should the HP Museum site ever shut down. But for now, what pier4r did was good enough. And as long as Dave keeps maintaining the HP Museum Forum I see little reason to create an online-viewable mirrored version of it.

In the interest of preserving the historic record, I've now posted a torrent with my processed version of his torrent here. This is completely usable offline, though navigating between messages without using the menus can be difficult due to the lost message hierarchy. All messages are browsable in the same manner as the offline version I made of the old museum, as well as the other discussion forums and newsgroups that I have torrents for. It has all posts through May 19, 2018, plus around 93% of the embedded images.

Also at this time, all subforums are combined into a single menu, though each post indicates the forum it came from. I might consider breaking up the separate forums at some point.

Screenshot of menu:



Download from here:

https://www.hpcalc.org/torrents/

[pier4r]

And Eric delivers more awesomeness! I am happy someone went through my attempt and found out that was not as broken as I imagined (I set an expectation to about 25% of the contents, more is gold surplus) and even processed it. Happy to help.

Now I am going to share also your new torrent.

As an info in terms of uploaded GBs I have at the moment the following.
My attempt to make an archive to the MyBB forum (update 201805): 20.69 GB uploaded.
hpcalc.org torrent from early 2018: 17.94 GB uploaded.
Hp41 dvd. 14.67 GB uploaded (plus some 11 or 12 GB before I relocated it and qbittorrent didn't like it. So like 25GB in total).
my hp calc torrent (see first page): 8.3 GB, but that is from September, without considering all the previous uploads.
Comp.sys.hp48 from eric. 0.5 GB
comp.sys.handhelds. 100 MB.
listserv.nodak.edu 12 MB.

I have a possible update for September, but as usual feel free to make suggestions!

[Eric Rechlin]

I suppose some stats on what I've uploaded for the torrents could be interesting too, rounded to the nearest 0.1 GB:

comp.sys.handhelds: 0.5 GB
comp.sys.hp48 2018-01-01: 1.0 GB
HP Emulators: 7.0 GB
HP Learning Modules: 1.2 GB
HP Museum Forum Archive: 2.6 GB
HP Photos: 4.0 GB
HP Slides: 4.6 GB
HP Solve: 1.7 GB
HP-41 DVD: 338.0 GB
201808 torrent: 0.0 GB
201805 torrent: 3.5 GB
hpcalc.org 2018-01-01: 100.0 GB
listserv.nodak.edu: 0.0 GB
Teenix Emulators: 2.8 GB

[pier4r]

I remember when you said "no one is interested" and after less than a year, 100GB uploaded (and I could contribute with almost 18 GB). Nice!
For such small community, it is quite something.