2018-07-07 Saturday - Researching BigDL Machine Learning Framework

Preparing my reading list to do a deep dive in BigDL:


References:

• https://github.com/intel-analytics/BigDL
• "BigDL is a distributed deep learning library for Apache Spark; with BigDL, users can write their deep learning applications as standard Spark programs, which can directly run on top of existing Spark or Hadoop clusters. To makes it easy to build Spark and BigDL applications, a high level Analytics Zoo is provided for end-to-end analytics + AI pipelines"
• https://bigdl-project.github.io/0.6.0/#getting-started/

• https://github.com/intel-analytics/BigDL-tutorials
• Step-by-step Deep Leaning Tutorials on Apache Spark using BigDL 

Talks:

• https://www.oreilly.com/ideas/deep-learning-for-apache-spark
• https://databricks.com/session/bigdl-a-distributed-deep-learning-library-on-spark
• BigDL: Distributed Deep Learning on Apache Spark | Intel Software
• BigDL: Bringing Ease of Use of Deep Learning for Apache Spark

Articles:

• https://www.infoq.com/news/2017/01/bigdl-deep-learning-on-spark
• Intel Open-Sources BigDL, Distributed Deep Learning Library for Apache Spark
• https://dzone.com/articles/deep-learning-with-intels-bigdl-and-apache-spark
• Deep Learning With Intel's BigDL and Apache Spark 
• Intel
• https\://software.intel.com/en-us/articles/bigdl-distributed-deep-learning-on-apache-spark
• BigDL: Distributed Deep Learning on Apache Spark
• AWS
• https://aws.amazon.com/blogs/machine-learning/running-bigdl-deep-learning-for-apache-spark-on-aws/
• Running BigDL, Deep Learning for Apache Spark, on AWS
• https://www.slideshare.net/AmazonWebServices/bigdl-image-recognition-using-apache-spark-with-bigdl-mcl358-reinvent-2017
• BigDL: Image Recognition Using Apache Spark with BigDL - MCL358 - re:Invent 2017 
• Google
• https://cloud.google.com/blog/big-data/2018/04/using-bigdl-for-deep-learning-with-apache-spark-and-google-cloud-dataproc
• Using BigDL for deep learning with Apache Spark and Google Cloud Dataproc
• IBM
• https://medium.com/ibm-data-science-experience/using-bigdl-in-data-science-experience-for-deep-learning-on-spark-f1cf30ad6ca0
• Using BigDL in Data Science Experience for Deep Learning on Spark
• Lightbend
• https://developer.lightbend.com/blog/2017-06-22-bigdl-on-mesos/index.html
• Using Apache Spark with Intel BigDL on Mesosphere DC/OS
• "BigDL is a distributed deep learning library from Intel released and open-sourced in 2016. Besides offering most of the popular neural net topologies out of the box, BigDL boasts of extremely high performance through its usage of Intel MKL library for numerical computation. BigDL supports import/export of networks pre-trained in TensorFlow, Caffe or Torch and there are plans to include interoperability with other libraries in the market. However, the most important feature that made us look into BigDL is its native integration with Apache Spark that enables users to leverage the distributed processing capabilities of Spark infrastructure for training and model serving. For enterprises already using Spark, BigDL works just like any other Spark library that supplements the machine learning capabilities offered by Spark ML."
• "Lightbend Fast Data Platform (FDP) uses Mesosphere DC/OS as the cluster manager. FDP aims to make it easier for customers to productize the use of BigDL through its offering by integrating Spark as part of the platform. Machine learning applications developed using BigDL and Spark can also take advantage of the best-in-class streaming engines, the Lightbend Reactive Platform and messaging technologies like Kafka that form the complete suite of FDP."
• https://www.lightbend.com/products/fast-data-platform
• Microsoft
• https://blogs.technet.microsoft.com/machinelearning/2017/06/20/running-bigdl-apache-spark-deep-learning-library-on-microsoft-data-science-virtual-machine/
• Running BigDL Apache Spark Deep Learning Library on Microsoft Data Science Virtual Machine
• Cloudera
• https://blog.cloudera.com/blog/2017/09/deep-learning-with-intels-bigdl-and-apache-spark/
• Deep Learning with Intel’s BigDL and Apache Spark
• Parallel Universe Magazine
• https://software.intel.com/en-us/download/parallel-universe-magazine-issue-28-april-2017
• https://software.intel.com/sites/default/files/managed/31/c3/parallel-universe-issue-28.pdf
• BigDL: Optimized Deep Learning on Apache Spark*, by Jason Dai and Radhika Rangarajan, Page-57
• https://www.bluedata.com/blog/2017/09/deep-learning-with-bigdl-and-apache-spark-on-docker/
• Deep Learning with BigDL and Apache Spark on Docker
• https://rise.cs.berkeley.edu/blog/accelerating-deep-learning-training-with-bigdl-and-drizzle-on-apache-spark/
• Accelerating Deep Learning Training with BigDL and Drizzle on Apache Spark
• https://software.intel.com/en-us/articles/building-large-scale-image-feature-extraction-with-bigdl-at-jdcom
• "experience and lessons learned from Intel and JD teams in building a large-scale image feature extraction framework using deep learning on Apache Spark* and BigDL"