IBM today announced several initiatives involving Spark and its Analytics business supporting enterprises.
The company plans to embed Spark into its Analytics and Commerce platforms, and offer Spark as a service on IBM Cloud. IBM will also put more than 3,500 IBM researchers and developers to work on Spark-related projects at more than a dozen labs. In addition, IBM will open a Spark Technology Center in San Francisco for the data science and developer community to boost innovation in intelligent applications.
The enterprise IT vendor will donate its IBM SystemML machine learning technology to the Spark open source ecosystem and collaborate with Databricks to advance Spark’s machine learning capabilities. IBM will educate more than one million data scientists and data engineers on Spark through partnerships with AMPLab,DataCamp, MetiStream, Galvanize and Big Data University MOOC.
IBM’s Watson Health Cloud will leverage Spark as a key underpinning for its insight platform. IBM will educate more than 1 million data scientists and data engineers on Spark
Beth Smith, general manager, Analytics Platform, IBM Analytics, said: “Our clients will benefit as we help them embrace Spark to advance their own data strategies to drive business transformation and competitive differentiation.”
Spark, together with IBM, provides a scalable platform for Optibus.
“It is easy for us to expand our software as a service offering into new markets, and helps us simplify deployment, maintenance and application development for transportation companies,” said Amos Haggiag, CTO and co-founder of Optibus.
Findability Sciences, a consulting and contextual data technology solutions company, is using IBM Analytics and Spark to help clients tap into the power of Big Data.
“Apache Spark with IBM BigInsights has given us capacity for our implementations for small and medium businesses, where MapReduce was not efficient. With Spark, the performance has improved multi fold. We’re now able to process streaming data from IoT devices and offer analytics for data in motion for things like traffic, commuters and parking,” said Anand Mahurkar, CEO of Findability Sciences.
Independence Blue Cross (IBC), a health insurer in the Philadelphia area, is using Spark to drive product innovation and develop new services.
“Apache Spark is maturing into a power tool for development of machine-learning analytic applications. It allows our IBC researchers and academic partners to work together more seamlessly, which means we can get new claims and benefits apps up and out to customers much faster,” said Darwin Leung, director of Informatics at Independence Blue Cross.
IBM, NASA, and the SETI Institute are collaborating to analyze terabytes of space radio signals using Spark’s machine learning capabilities in a hunt for patterns that might betray the presence of intelligent extraterrestrial life.
“With Spark as a Service on Bluemix, we’ll be able to work with IBM to develop promising new ways to analyze signal data as we hunt for evidence of intelligence elsewhere in the cosmos. This is an exciting example of synergy in the service of science,” said Seth Shostak, senior astronomer and director of the Center for SETI Research.