14 - Big Data / Parallel

Overview

  • R is single threaded
  • It math libraries may not be
  • parallel package as perfect start
    • mclapply
    • parLapply
  • simple benchmarking
  • mention foreach, future, …
  • extend to HPC, use ICC ?
  • big data / external memory / bigmemory