Home

From Apache Spark Documentation
Jump to: navigation, search
Need help with Spark, contact us @ [email protected] or Jump to our website Sigmoid Analytics

Welcome to Sigmoid! If you are not sure how to get started, here are a few places to find the information you are looking for:


Contents

Overview

Spark/Shark Setup

Spark

  1. EC2
  2. EMR
  3. GCE(Google Compute Engine)
  4. Local
  5. Mesos


Shark

  1. Local
  2. EC2

Common Configurations

Pig on Spark

Spark Cloud Computing Setup

Spark Dev Guide

Spark Batch Processing


Spark Streaming

  • Spark Streaming - Understands the component of Spark that provides highly scalable, fault-tolerant streaming processing


Spark - Additional tools

  • BlinkDB - A large-scale data warehouse system like Shark
  • Java 7 - Download and Installation of Java 7
  • Maven - Download and Installation of Maven
  • Thrift - Download and Installation of Thrift

Spark with Tachyon

  • Tachyon - Introduction to Tachyon


Documentation, Slides & Videos


Other Documents


Common Problems while using Spark/Shark

Need help with Spark, contact us @ [email protected] or Jump to our website Sigmoid Analytics