Introduction

Become an expert in Apache Flume. Keen Technologies Apache Flume training includes Overview, Architecture, Data flow mode, Reliability and Recoverability. Get certified in Apache Flume

Course Content

Introduction

• Overview
• Architecture
• Data flow model
• Reliability and Recoverability

Setting Up An Agent

• Configuring individual components
• Wiring the pieces together
• Data ingestion

Executing Commands

• Network streams

Setting Multi-Agent Flow

• Consolidation
• Multiplexing the flow
• Configuration
• Defining the flow
• Configuring individual components
• Adding multiple flows in an agent

Configuring A Multi Agent Flow

• Fan out flow
• Flume Sources
• Avro Source, Exec Source
• NetCat Source
• Sequence Generator Source
• Syslog Sources
• Syslog TCP Source
• Syslog UDP Source
• Legacy Sources
• Avro Legacy Source
• Thrift Legacy Source
• Custom Source

Flume Sinks

• HDFS Sink
• Logger Sink
• Avro Sink
• IRC Sink
• File Roll Sink
• Null Sink
• HbaseSinks
• HbaseSink
• AsyncHBaseSink
• Custom Sink

Flume Channels

• Memory Channel
• JDBC Channel
• Recoverable Memory Channel
• File Channel, Pseudo Transaction Channel
• Custom Channel
• Flume Channel Selectors
• Replicating Channel Selector
• Multiplexing Channel Selector
• Custom Channel Selector

Flume Sink Processors

• Default Sink Processor
• Failover Sink Processor
• Load balancing Sink Processor
• Custom Sink Processor

Flume Interceptors

• Timestamp Interceptor
• Host Interceptor
• Flume Properties
• Property

Security

• Monitoring
• Troubleshooting
• Handling agent failures
• Compatibility
• HDFS
• sAVRO