Claire Keane
Love Begins
h
wallacepolsom
No title available
Aqua Utopia｜海の底で記憶を紡ぐ
roma★
ojovivo
trying on a metaphor
Monterey Bay Aquarium
Mike Driver
Acquired Stardust
d e v o n
No title available
I'd rather be in outer space 🛸
Keni
YOU ARE THE REASON
Game of Thrones Daily
art blog(derogatory)
祝日 / Permanent Vacation
seen from Singapore
seen from United States
seen from Indonesia
seen from France
seen from United States
seen from United States
seen from South Africa
seen from Malaysia
seen from United States
seen from Singapore
seen from Türkiye
seen from United States
seen from United States
seen from United States
seen from United States
seen from India
seen from Brazil
seen from Italy
seen from Italy
seen from Japan
@hadooptutorial-blog
Cassandra Overview
Cassandra Overview
Cassandra is another no-sql database. Similar to Hbase it is also distributed column-oriented database to handle big data workloads across multiple nodes but it can support both Local File system and HDFS, whereas in Hbase the underlying file system is also HDFS.
It overcomes single point of failure by using a peer-to-peer distributed system across homogeneous nodes where data…
View On WordPress
Impala Commands Cheat Sheet
Impala Commands Cheat Sheet
This is quick touch on Impala commands and Functions. Impala accepts basic SQL syntax and below is the list of a few operators and commands that can be used inside Impala. This is just a quick cheat sheet.
Databases
In Impala, a database is a logical container for a group of tables. Each database defines a separate namespace. Within a database, you can refer to the tables inside it using their…
View On WordPress
Impala Introduction
Cloudera provides a separate tool called, Impala to overcome the slowness of Hive Queries. Impala queries are more or less same as Hive Queries but they run very faster than Hive Queries. When we are dealing with medium sized data sets and we expect real time response from our queries then choosing Impala is the best option but Impala is available only in Cloudera’s Hadoop distribution only. This…
View On WordPress
HCatalog and Pig Integration
HCatalog and Pig Integration
HCatalog and Pig Integration
In short, HCatalog opens up the hive metadata to other mapreduce tools. Every mapreduce tools has its own notion about HDFS data (example Pig sees the HDFS data as set of files, Hive sees it as tables). With having table based abstraction, HCatalog supported mapreduce tools do not need to care about where the data is stored, in which format and storage location (HBase…
View On WordPress
Scala Installation in Ubuntu
Scala Installation in Ubuntu
In this post, we will describe the procedure for Scala Installation on Ubuntu Machine.
Prerequisite:
Below are the basic requirement for Scala installation on Ubuntu and getting started.
Java 1.5 or Later versions installed and JAVA_HOME environment variable set to Java installation directory
Scala Installation Procedure:
Download the latest stable version of Scala from http://www.scala-lang.org/…
View On WordPress
Introduction to Scala
These days majority of the hadoop applications/tools are being built in Scala Programming language than in Java. So it is good for hadoop developers/Java programmers to learn Scala as well. This post is just an introduction to Scala.
What’s Scala?
Scala is a hybrid functional and object-oriented programming language which runs on JVM (Java Virtual Machine). The name is an acronym for Scalable…
View On WordPress
John Onlan
View On WordPress
Sarah Goodling
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua.
View On WordPress
Kafka Installation and Test Broker Setup
Kafka Installation and Test Broker Setup
In this post we will discuss about Kafka Installation and Test Broker Setup in Ubuntu machine in a stand-alone zookeeper mode.
Step 1: Download
First download latest statble verion of kafka from Apache Download Mirrors . In this post we are installing kafka_2.11-0.8.2.1.tgz and untar it into /usr/lib/kafka folder.
Step 2:
Add below entries into .bashrc file
### kafka Home directory ####
export…
View On WordPress
HBase Functions Cheat Sheet
HBase Functions Cheat Sheet
HBase Functions Cheat Sheet
SHELL [cloudera@quickstart ~]$ hbase shell
LIST
hbase(main):003:0> list
SCAN
Scanner specifications may include one or more of: TIMERANGE, FILTER, LIMIT, STARTROW, STOPROW, TIMESTAMP, MAXLENGTH, or COLUMNS, CACHE. If no columns are specified, all columns will be scanned. To scan all members of a column family, leave the qualifier empty as in ‘col_family:’ hbase(main):01…
View On WordPress
Good SQL Queries Collection
Good SQL Queries Collection
Good SQL Queries Collection
/* CREATE TABLE FOR DEPARTMENT */ CREATE TABLE DEPARTMENT ( “DEPT_ID” NUMBER, “DEPT_NAME” VARCHAR2(30), PRIMARY KEY (“DEPT_ID”) )
/* CREATE TABLE FOR EMP */ CREATE TABLE EMPLOYEE ( “EMP_ID” NUMBER, “MGR_ID” NUMBER, “DEPT_ID” NUMBER, “EMP_NAME” VARCHAR2(30), “SAL” NUMBER, “DOJ” DATE, PRIMARY KEY (“EMP_ID”) ENABLE, FOREIGN KEY (“MGR_ID”) REFERENCES EMPLOYEE (“EMP_ID”)…
View On WordPress
Real Time Hadoop Interview Questions From Different Readers
Real Time Hadoop Interview Questions From Different Readers
Interview Questions from interviews
Hive – Where do you use Internal or Managed table? What scenarios?
In your resume, what do you mean by, “monitoring & managing MapReduce jobs”? Explain?
Interviewer’s Project: How to modify the RDBMs’ Nested SQL queries into Hadoop framework using Pig.
Sqoop: Need to know very well. Some of the current projects are importing data from other RDBMs sources into…
View On WordPress
Hadoop Testing Tools
Hadoop Testing Tools
MRUnit – Java framework that helps developers unit test Hadoop Map reduce jobs.
Mockito – Java Framework, similar to MRUnit for unit testing Hadoop Map reduce jobs.
PigUnit – Java framework that helps developers unit test Pig Scripts.
HiveRunner – An Open Source unit test framework for hadoop hivequeries based on JUnit4
Beetest – Unit Testing Framework for Hive Queries
Hiv…
View On WordPress
String Functions in Hive
String Functions in Hive
This post is about basic String Functions in Hive with syntax and examples.
Creating Table in HIVE:
hive> create external table Tri100(id int,name string,location varchar(30),sal int,Hike int) > row format delimited > fields terminated by ',' > lines terminated by '\n' > stored as textfile location '/Jayanth/Jay/';
String Functions and Normal Queries:
hive> select * from Tri100; 1 rahul …
View On WordPress
Oozie passing argument
Deciding How to Pass Arguments to Oozie Jobs So far, you have learned about several ways to pass parameters to an Oozie job. To help you decide which approach to use, you should first understand how Oozie uses parameters: ➤ Oozie uses parameters explicitly defined inside an action’s <arg> tag. ➤ If any of the parameters cannot be resolved there, Oozie uses parameters defined in the file specified…
View On WordPress
HIVE Aggregate Functions
HIVE Aggregate Functions hive> create table Tri100(id int,name string,location varchar(30),sal int) > row format delimited > fields terminated by ‘,’ > lines terminated by ‘\n’ > stored as textfile location ‘/Jayanth/Jay/';
OK Time taken: 0.688 seconds
hive> select * from Tri100;
OK 1 rahul Hyderabad 30000 2 Mohit Banglore 22000 3 Rohan Banglore 33000 4…
View On WordPress
HIVE Date Functions
HIVE Date Functions : Date data types do not exist in Hive. In fact the dates are treated as strings in Hive. The date functions are listed below. From_unixtime :
This function converts the number of seconds from unix epoch (1970-01-01 00:00:00 UTC) to a STRING that represents the TIMESTAMP of that moment in the current system time zone in the format of “1970-01-01 00:00:00″.…
View On WordPress