Apache ORC Training in Exeter

Apache ORC Training Course Outline

Module 1: Introduction to Apache ORC

• What is Apache ORC?
• ORC Adapters
• ORC Types
• Level of Indexes
• ACID Support

Module 2: Building ORC

• Building
  • Both C++ and Java
  • Java
  • C++
  • Specify Third-Party Libraries for C++ Build

Module 3: Using in Spark

• Spark DDL
• Spark Configuration

Module 4: Using in Python

• PyArrow
• Dask

Module 5: Using in Hive

• Hive DDL
• Hive Configuration
  • Table Properties
  • Configuration Properties

Module 6: Using in MapReduce

• Reading ORC Files
• Writing ORC Files
• Sending OrcStruct, OrcList, OrcMap, or OrcUnion through the Shuffle

Module 7: Using ORC Core

• Core Java
• Core C++

Module 8: Apache ORC Tools

• C++ Tools
  • orc-contents
  • orc-metadata
  • csv-import
  • orc-scan
  • orc-statistics
• Java Tools
  • Java Meta
  • Java Data and Scan
  • Java Convert
  • Java JSON Schema

Who should attend this Apache ORC Training Course?

The Apache Optimised Row Columnar (ORC) Training is a specialised course aimed to provide Engineers, Architects, and Developers with an in-depth understanding of high-performance columnar storage format used in the Hadoop ecosystem. The following are some professionals who can benefit from this course:

• Data Engineers
• Big Data Developers
• Database Administrators
• Data Scientists
• Hadoop Administrators
• Cloud Engineers
• ETL Developers

Prerequisites of the Apache ORC Training Course

There are no formal prerequisites for this Apache ORC Training Course. However, a basic understanding of Hadoop would be useful.

Apache ORC Training​ Course Overview

Apache is a non-profit organisation that helps those open-source software projects that are released under the license of Apache. Apache ORC is a self-describing columnar file format enabling efficient querying and storage of data on Hadoop. It uses multi-version concurrency control for supporting ACID transactions. This Apache ORC Training is designed to equip delegates with a detailed knowledge of Apache ORC.

The Knowledge Academy’s Apache OCR Training will introduce delegates to ORC adapters and types. Delegates will gain knowledge of Apache ORC’s three levels of indexes. In addition, delegates will learn how to build Apache ORC. Delegates will get familiarised with hive DDL and configuration, including table and configuration properties.

During this 1-day course, delegates will learn how to read and write ORC files. Delegates will get an understanding of how to send OrcStruct, OrcList, OrcMap through the shuffle. This Apache ORC Training will fully prepare delegates on how to use Apache ORC tools – C++ and Java tools. Post completion of this training, delegates will be able to use Java meta, data, scan, convert, and JSON Schema.

Course Objectives

• To understand fundamentals of Apache ORC and its architectur
• To apply ORC with Python frameworks like PyArrow and Dask
• To implement ORC in MapReduce for file processing
• To utilise ORC Core in both Java and C++ environments
• To explore ORC tools for scanning and data management
• To optimise big data operations with ORC integration

After attending this training, delegates will be able to confidently apply Apache ORC in big data environments to enhance storage efficiency, query performance, and system scalability. They will be capable of building and integrating ORC with multiple platforms, including Spark, Hive, MapReduce, and Python, to streamline data workflows. Delegates will also be skilled in using ORC tools to inspect metadata, manage content, and convert formats for improved data handling.

What’s included in this Apache ORC Training Course?

• World-Class Training Sessions from Experienced Instructors
• Apache ORC Certificate
• Digital Delegate Pack