In this special technology white paper, Looker for Hadoop – Interactive Analytics, Visualizations and Data Modeling on large Hadoop Data Sets, you’ll learn how the vision of Hadoop as more than a data store is finally a reality. Thanks to advances from SQL query engines like Spark SQL, Impala, Presto and Hive on Tez, big data technologies are now accessible for business analytics. With Looker, analysts can build a data model across all their data in Hadoop – easily transforming raw data into meaningful metrics and finally allowing business teams to access and explore years of stored data in Hadoop.
Looker is an in-database analytics engine that makes it possible for your data analysts to curate complex Hadoop data sets. Typically, data analysts will work in conjunction with the Hadoop operations team to organize and optimize how data is organized in HDFS (or S3) and the corresponding SQL engine. This is not necessary for more traditional SQL data sources like an RDBMS, but considering the sheer size and unstructured nature of Hadoop data sets, it is essential.
The Hadoop platform has achieved unprecedented growth in deployments across both enterprise and cloud service providers because it succeeds in easily and cheaply capturing huge amounts of unstructured data. As a data store, the Hadoop File System (HDFS) has quickly emerged as a standard for storing and managing petabytes of data of all types. However,The ability to turn this growing deluge of data into actionable intelligence and useful interactive applications has been a more difficult and complicated problem to solve. The early success of the Hadoop platform has inspired exciting many exciting conversations between business, academic and scientific professionals about the possibilities now available with such a wealth of data. This resulted in a dizzying array of databases and programmatic approaches being built in an attempt to extract value from Hadoop data
The white paper includes the following sections:
- For the Love of Data
- Challenges of Analytics on Hadoop
- The Growing SQL Revolution
- Looker: A Lense Over All Your Data
- Optimizing Roles for Hadoop
- LookML Data Modeling and Hadoop
The Looker for Hadoop – Interactive Analytics, Visualizations and Data Modeling on large Hadoop Data Sets white paper is available for download in PDF from the insideAI News White Paper Library, courtesy of Looker.