Skip to content
This repository has been archived by the owner on Jun 17, 2024. It is now read-only.
/ Dryad Public archive

This is a research prototype of the Dryad and DryadLINQ data-parallel processing frameworks running on Hadoop YARN.

License

Notifications You must be signed in to change notification settings

MicrosoftResearch/Dryad

Repository files navigation

Dryad

This is a research prototype of the Dryad and DryadLINQ data-parallel 
processing frameworks running on Hadoop YARN.  Dryad utilizes cluster 
services provided as part of Hadoop YARN to reliably execute 
distributed computations on a cluster of computers. DryadLINQ provides
the LINQ programming model for distributed data processing and leverages 
Dryad for reliable execution.

If you just want to run a sample DryadLINQ program, the simplest way to get started
is to follow the instructions at 
http://microsoftresearch.github.io/Dryad/?topic=html/e992fd94-c956-481d-82e6-dbdf45daa722.htm

Requirements

Visual Studio 2013
An Azure HDInsight 3.1 cluster or a Windows YARN cluster composed of x64 machines

Building Dryad

1) Clone the Dryad git repository.
2) Use Visual Studio to open The Dryad solution file (Dryad.sln) located 
   in the root of the repository and build the solution.  The dependencies
   will be fetched from NuGet.

About

This is a research prototype of the Dryad and DryadLINQ data-parallel processing frameworks running on Hadoop YARN.

Resources

License

Stars

Watchers

Forks

Packages

No packages published