You Are Here: Home » Amazon AWS

Unite Real-Time and Batch Analytics Using the Big Data Lambda Architecture, Without Servers! | AWS Big Data Blog

The Big Data Lambda Architecture seeks to provide data engineers and architects with a scalable, fault-tolerant data processing architecture and framework using loosely coupled, distributed systems. At a high level, the Lambda Architecture is designed to handle both real-time and historically aggregated batched data in an integrated fashion. It separates the duties of real-time and batch processing so purpo ...

Read more

Serverless Scaling for Ingesting, Aggregating, and Visualizing Apache Logs with Amazon Kinesis Firehose, AWS Lambda, and Amazon Elasticsearch Service | AWS Database Blog

In 2016, AWS introduced the EKK stack (Amazon Elasticsearch Service, Amazon Kinesis, and Kibana, an open source plugin from Elastic) as an alternative to ELK (Amazon Elasticsearch Service, the open source tool Logstash, and Kibana) for ingesting and visualizing Apache logs. One of the main features of the EKK stack is that the data transformation is handled via the Amazon Kinesis Firehose agent. In this pos ...

Read more

Manage Query Workloads with Query Monitoring Rules in Amazon Redshift | AWS Big Data Blog

Data warehousing workloads are known for high variability due to seasonality, potentially expensive exploratory queries, and the varying skill levels of SQL developers. To obtain high performance in the face of highly variable workloads, Amazon Redshift workload management (WLM) enables you to flexibly manage priorities and resource usage. With WLM, short, fast-running queries don’t get stuck in queues behi ...

Read more

Send Apache Web Logs to Amazon Elasticsearch Service with Kinesis Firehose | AWS Database Blog

We have many customers who own and operate Elasticsearch, Logstash, and Kibana (ELK) stacks to load and visualize Apache web logs, among other log types. Amazon Elasticsearch Service provides Elasticsearch and Kibana in the AWS Cloud in a way that’s easy to set up and operate. Amazon Kinesis Firehose provides reliable, serverless delivery of Apache web logs (or other log data) to Amazon Elasticsearch Servic ...

Read more

Google’s new cloud service eases data preparation for machine learning | Computerworld

Google's new cloud service eases data preparation for machine learning BigQuery gets a bunch of updates for big data, too One of the challenges that data scientists face when running machine learning workloads is processing information before it’s ready for use. Google unveiled a new cloud service Thursday aimed at easing that pain.Google Cloud Dataprep will automatically detect data schemas, joins, and ano ...

Read more

Why Voice Won’t Replace Screen Search 

Why Voice Won't Replace Screen Search With more than 30 million voice-first devices expected in U.S. homes before the end of the year, it’s no wonder there is so much buzz about voice, the user interface that will transform how brands and marketers engage with customers.There’s a lot of talk that companies need to prepare for a world where voice is the primary — or even the only — way consumers will interac ...

Read more

Why the Financial Sector in India is betting big on Chatbots

Why the Financial Sector in India is betting big on Chatbots Banking gets smarter with as Deep Learning and NLP technologiesHere’s a common scenario in the financial sector – high volume customer support tasks are being standardized and executed by chatbots or software applications that can be scaled up accordingly and are streamlining operations.  From insurance discovery, buying and renewal to handling da ...

Read more

Implement Serverless Log Analytics Using Amazon Kinesis Analytics | AWS Big Data Blog

Applications log a large amount of data that—when analyzed in real time—provides significant insight into your applications. Real-time log analysis can be used to ensure security compliance, troubleshoot operation events, identify application usage patterns, and much more. Ingesting and analyzing this data in real time can be accomplished by using a variety of open source tools on Amazon EC2. Alternatively, ...

Read more

Amazon Web Services’ secret weapon: Its custom-made hardware and network – GeekWire

It’s not unusual for internet and software giants to design and even make their own hardware, to increase efficiency and build a competitive advantage. Google custom-designs its own servers, filling them with millions of chips from Intel, and announced in May that it has designed its own application-specific integrated circuit (ASIC) for use on neural networks. Facebook uses its own switches in its data cen ...

Read more

Powering Amazon Redshift Analytics with Apache Spark and Amazon Machine Learning | AWS Big Data Blog

Air travel can be stressful due to the many factors that are simply out of airline passengers’ control. As passengers, we want to minimize this stress as much as we can. We can do this by using past data to make predictions about how likely a flight will be delayed based on the time of day or the airline carrier. In this post, we generate a predictive model for flight delays that can be used to help us pick ...

Read more

2015 © Big Data Cloud Inc. All Rights Reserved.

Hadoop and the Hadoop elephant logo, Sprark are trademarks of the Apache Software Foundation.

Scroll to top