1 / 18

HIVE

Nagarjuna K. HIVE. Pre Requisites . Knowledge about SQL. History . Built by Jeff’s tea at FaceBook A tool built for data warehousing on top of hadoop. Why HIVE. huge volumes of data FB producing burgeoning Social Network How to analyze the data ?. Hadoop EcoSystems. What is HIVE.

salma
Download Presentation

HIVE

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Nagarjuna K HIVE [email protected]

  2. Pre Requisites • Knowledge about SQL [email protected]

  3. History • Built by Jeff’s tea at FaceBook • A tool built for data warehousing on top of hadoop [email protected]

  4. Why HIVE • huge volumes of data FB producing • burgeoning Social Network • How to analyze the data ? [email protected]

  5. Hadoop EcoSystems [email protected]

  6. What is HIVE • Tools to enable easy data extract/transform/load (ETL) • A mechanism to impose structure on a variety of data formats • Access to files stored either directly in Apache HDFSTM or in other data storage systems such as Apache HBaseTM • Query execution via MapReduce [email protected]

  7. Who are using HIVE [email protected]

  8. What is Hive For • What is hadoop for ? • && • adhoc batch processing of data. [email protected]

  9. What is Hive not for • What is hadoop not for ? • real time data processing • row level updates [email protected]

  10. What hive values most • What Hadoop values most ? • scalability • extensibility (MapReduce and UDF/UDAF/UDTF) • fault tolerance • loose coupling(input formats) [email protected]

  11. Hive - Set Up • Setting Up hive • derby metastore [email protected]

  12. Configuration files • hive –site.xml • $HIVE_HOME/conf/hive-site.xml • Alternate way • hive --config /Users/tom/dev/hive-conf • You have two or more clusters • You alternate frequently [email protected]

  13. Hive Tables • Two types of tables • External Table • Table created on top of the existing data • delete the table  data still persistent • Normal Table • Tables location is in hives default location • delete the table  data gone [email protected]

  14. Hive Usage • shell • $HIVE_HOME/bin/hive [email protected]

  15. Hive Usage • describing a table • desc <table_Name> • Listing all the inbuilt functions • show functions; • Describing a function • desc function <function_name> [email protected]

  16. Create Table • Employee1 | Name 1 |Address1|Phone 1 • create external table (Key1 String, Name Strng,Address String, Phone String) row format delimited fields terminated by ‘|’ location ‘/….’; [email protected]

  17. Operations in hive • https://cwiki.apache.org/confluence/display/Hive/GettingStarted [email protected]

  18. Operations in hive • https://cwiki.apache.org/confluence/display/Hive/GettingStarted [email protected]

More Related
OSZAR »