You Are Here: Home » Natural Language Processing

Using Apache Spark for large-scale language model training | Engineering Blog | Facebook Code

Processing large-scale data is at the heart of what the data infrastructure group does at Facebook. Over the years we have seen tremendous growth in our analytics needs, and to satisfy those needs we either have to design and build a new system or adopt an existing open source solution and improve it so it works at our scale. For some of our batch-processing use cases we decided to use Apache Spark, a fast- ...

Read more

Why Businesses are Leaning towards Machine Learning … 

Many companies are slowly waking up each day to the smell of a new coffee. It's called Machine Learning! Machine Learning is here to stay. It is expected to influence every aspect of life, including the way business decisions will be made in future. It's already happening. Machine Learning phenomenon: Machine Learning is a shortcut for machines or systems to learn the way decisions are made in life, which a ...

Read more

Review: The best frameworks for machine learning and deep learning | InfoWorld

Over the past year I've reviewed half a dozen open source machine learning and/or deep learning frameworks: Caffe, Microsoft Cognitive Toolkit (aka CNTK 2), MXNet, Scikit-learn, Spark MLlib, and TensorFlow. If I had cast my net even wider, I might well have covered a few other popular frameworks, including Theano (a 10-year-old Python deep learning and machine learning framework), Keras (a deep learning fro ...

Read more

Google Cloud Platform Blog: Introducing Cloud Spanner: a global database service for mission-critical applications

Introducing Cloud Spanner: a global database service for mission-critical applications Today, we’re excited to announce the public beta for Cloud Spanner, a globally distributed relational database service that lets customers have their cake and eat it too: ACID transactions and SQL semantics, without giving up horizontal scaling and high availability. When building cloud applications, database administrato ...

Read more

Microsoft’s New AI Writes Code For People Who Don’t Know Coding

DeepCoder is an artificial intelligence system built by the researchers at Microsoft and the University of Cambridge. Based on a technique called program synthesis, DeepCoder can write working code after searching from a huge code database. It tries to make the best possible arrangement for the harvested code fragments and improves its efficiency over time. We’ve about the very basic artificial intelligence ...

Read more

How AI Is Changing The Way Companies Are Organized

Artificial Intelligence may still be in its infancy, but it’s already forcing leadership teams around the world to reconsider some of their core structures. Advances in technology are causing firms to restructure their organizational makeup, transform their HR departments, develop new training models, and reevaluate their hiring practices. This is according to Deloitte’s 2017 Human Capital Trends Report, wh ...

Read more

Experts on the Pros and Cons of Algorithms | Pew Research Center

Code-Dependent: Pros and Cons of the Algorithm Age Algorithms are aimed at optimizing everything. They can save lives, make things easier and conquer chaos. Still, experts worry they can also put too much control in the hands of corporations and governments, perpetuate bias, create filter bubbles, cut choices, creativity and serendipity, and could result in greater unemployment (filistimlyanin/iStock.com) A ...

Read more

Yahoo supercharges TensorFlow with Apache Spark 

Yahoo, model Apache Spark citizen and developer of CaffeOnSpark, which made it easier for developers building deep learning models in Caffe to scale with parallel processing, is open sourcing a new project called TensorFlowOnSpark. The pairing of Spark and TensorFlow should make the deep learning framework more attractive to developers who are creating models that need to run on large computing clusters. Fo ...

Read more

Research Blog: Using Machine Learning to predict parking difficulty

"When Solomon said there was a time and a place for everything he had not encountered the problem of parking his automobile." -Bob Edwards, Broadcast Journalist Much of driving is spent either stuck in traffic or looking for parking. With products like Google Maps and Waze, it is our long-standing goal to help people navigate the roads easily and efficiently. But until now, there wasn’t a tool to address th ...

Read more

Beyond vectors: efficiency in Natural Language Processing

NYU MSDS student Raul Delgado Sanchez talks diffusion maps When you text a friend saying ‘I’ll fall you later’, how does your iPhone know to correct ‘fall’ to ‘call’? Auto-correct owes its prowess to a field that continues to gain paramount importance among computer scientists, and is an especially lively area of study at our very own Center for Data Science: Natural Language Processing (NLP). Generally spe ...

Read more

2015 © Big Data Cloud Inc. All Rights Reserved.

Hadoop and the Hadoop elephant logo, Sprark are trademarks of the Apache Software Foundation.

Scroll to top