#prestodb

[reportwire]

Hands on Presto Tutorial: Presto 103

Hands on Presto Tutorial: Presto 103

Introduction This tutorial is Part III of our getting started with Presto series. As a reminder, PrestoDB is an open source distributed SQL query engine. In tutorial 101, we showed you how to install and configure presto locally, and in tutorial 102, we covered how to run a three-node PrestoDB cluster on a laptop. In this tutorial, we’ll show you how to run a PrestoDB cluster in a GCP environment…

View On WordPress

[garystafford]

Presto Federated Queries: Getting Started with Presto Federated Queries using Ahana’s PrestoDB Sandbox on AWS

Presto Federated Queries: Getting Started with Presto Federated Queries using Ahana’s PrestoDB Sandbox on AWS

https://soundcloud.com/gary-stafford-214522524/introduction-getting-started-with-presto-federated-queries-using-ahanas-prestodb-sandbox-on-aws Audio introduction to the post Introduction

According to The Presto Foundation, Presto (aka PrestoDB), not to be confused with PrestoSQL, is an open-source, distributed, ANSI SQL compliant query engine. Presto is designed to run interactive ad-hoc…

View On WordPress

[notes-alessiosignorini]

PrestoDB: use CSV saved on S3

Adding an S3 bucket to Presto is not difficult. You just run something like

CREATE TABLE hive.default.features ( first_name VARCHAR, [...] ) WITH ( format = 'TEXTFILE', external_location = 's3://bucketname/path1/path2/' );

in the presto-cli and it's done.

The caveat is that Presto does not seem to have any option to specify the column delimiter so if you want to make everything work out of the box you need to use the HEX character \x01 as delimiter.

I used this command to convert my CSV file before uploading it

sed 's/\x2C/\x01/g' file.csv | gzip -9 -c > 20170317.textfile.gz

It took me a few hours to get to this solution and I hope this post will save this time to many others.

[felbus]

nosql with sql - prestodb is open sourced

http://prestodb.io/ WHAT IS PRESTO? Presto is an open source distributed SQL query engine for running interactive analytic queries against data sources of all sizes ranging from gigabytes to petabytes. Presto was designed and written from the ground up for interactive analytics and approaches the speed of commercial data warehouses while scaling to the size of organizations like Facebook. WHAT CAN IT DO? Presto allows querying data where it lives, including Hive, HBase, relational databases or even proprietary data stores. A single Presto query can combine data from multiple sources, allowing for analytics across your entire organization. Presto is targeted at analysts who expect response times ranging from sub-second to minutes. Presto breaks the false choice between having fast analytics using an expensive commercial solution or using a slow "free" solution that requires excessive hardware. WHO USES IT? Facebook uses Presto for interactive queries against several internal data stores, including their 300PB data warehouse. Over 1,000 Facebook employees use Presto daily to run more than 30,000 queries that in total scan over a petabyte each per day. Leading internet companies including Airbnb and Dropbox are using Presto. Presto is amazing. Lead engineer Andy Kramolisch got it into production in just a few days. It's an order of magnitude faster than Hive in most our use cases. It reads directly from HDFS, so unlike Redshift, there isn't a lot of ETL before you can use it. It just works. Christopher Gutierrez, Manager of Online Analytics, Airbnb We're really excited about Presto. We're planning on using it to quickly gain insight about the different ways our users use Dropbox, as well as diagnosing problems they encounter along the way. In our tests so far it's been rock solid and extremely fast when applied to some of our most important ad hoc use cases. Fred Wulff, Software Engineer, Dropbox