http://en.wikipedia.org/wiki/Parallel_computing

• contains lots of useful links to good resources on parallel computing. Explains Flynn's taxonomy and so on.
• http://www.llnl.gov/computing/tutorials/parallel_comp/ - a neat concise introduction
• http://www.parawiki.org/index.php/Main_Page - a wiki about parallelism
• http://en.wikipedia.org/wiki/List_of_important_publications_in_computer_science#Parallel_computing - some things to read
• http://www.pmodels.org/ - center of people who care about paralle programming
• http://citeseer.ist.psu.edu/cis?q=parallel+and+programming - suggested cite seer search
• http://en.wikipedia.org/wiki/Concurrent_programming - things that have to do with concurrent programming, extension to parallel programming
• references on amdahl and Gustofson
  • http://en.wikipedia.org/wiki/Amdahls_Law
  • Gene Amdahl, "Validity of the Single Processor Approach to Achieving Large-Scale Computing Capabilities", AFIPS Conference Proceedings, (30), pp. 483-485, 1967
  • http://en.wikipedia.org/wiki/Gustafson%27s_Law - disagreed with Amdahl
  • http://www.scl.ameslab.gov/Publications/Gus/AmdahlsLaw/Amdahls.html - Gustovson's analysis that Amdahl was too pessemistic
  • http://joda.cis.temple.edu/~shi/docs/amdahl/amdahl.html - analysis of both methods

The next place to check was concurrent computing

http://en.wikipedia.org/wiki/Concurrent_programming

• Contains a good list of parallel programming languages.
• http://c2.com/cgi/wiki?FutureValue - instead of instantly computing results, promise to deliver the results in the futer
• http://c2.com/cgi/wiki?PromisePipelining - same idea
• http://cml.cs.uchicago.edu/ - a concurrent ml based out of chicago. This guy was trying to recuruit me.
  • processes for algorithm analysis
    • http://en.wikipedia.org/wiki/Ambient_calculus
    • http://en.wikipedia.org/wiki/Calculus_of_Communicating_Systems
    • http://en.wikipedia.org/wiki/Communicating_Sequential_Processes
    • http://en.wikipedia.org/wiki/Petri_net - mathematical description of a distributed system
    • http://en.wikipedia.org/wiki/Actor_model
    • http://en.wikipedia.org/wiki/Parallel_Random_Access_Machine
    • http://en.wikipedia.org/wiki/Process_calculi
• http://en.wikipedia.org/wiki/Lock-free_and_wait-free_algorithms - looks interesting

Next, I went to read the introduction to the field

http://www.llnl.gov/computing/tutorials/parallel_comp/

• a good reference on the basics of parallel computation. Short and effective, useful to show to new people
• http://www.llnl.gov/computing/tutorials/performance_tools/ - guide to parallel performanc evaluation

Next, because I want to go over something easy, I went to look at lock-free algorithms. i have heard of this once before in the context of kernel operations, and I always wanted to know how it worked.

http://en.wikipedia.org/wiki/Lock-free_and_wait-free_algorithms

• contains a simple description for lock-free algorithms, along with some references on how they are designed. Abandoning this search for now, though it might prove useful for something like ParFUM?
• http://en.wikipedia.org/wiki/Software_transactional_memory

http://en.wikipedia.org/wiki/Software_transactional_memory

• Might be VERY useful, contains references to transactional memory and how it's used in concurent systems. Samoe comcurrent versions of programs already have constructs for this.
• lots of references to languages and bibliographies. Good reading material

Languages I should investigate

• Data parallel
  • http://en.wikipedia.org/wiki/ZPL_programming_language
  • http://en.wikipedia.org/wiki/NESL
• streaming/dataflow
  • http://en.wikipedia.org/wiki/SISAL
  • http://en.wikipedia.org/wiki/Joule_programming_language
• unknown
  • http://en.wikipedia.org/wiki/Afnix_programming_language - functional parallel
  • http://en.wikipedia.org/wiki/C%CF%89 - rpc in C#
  • http://en.wikipedia.org/wiki/Cilk - very close to the language I wanted.
  • http://en.wikipedia.org/wiki/Join_Java - java with join operations. I've seem similar things for ocaml
  • http://en.wikipedia.org/wiki/MultiLisp - parallel lisp
  • http://en.wikipedia.org/wiki/Occam_programming_language - not realted to ocaml, implements the semantics of CSP
  • only listing promising leads from now on
• list of links to programming languages
  • http://en.wikipedia.org/wiki/Concurrent_programming
  • http://en.wikipedia.org/wiki/Category:Concurrent_programming_languages