What's New?

June 8, 2011 - Come see us presenting Phoenix++ in MAPREDUCE'11
June 6, 2011 - Phoenix++ released

What is Phoenix?

Phoenix is a shared-memory implementation of Google's MapReduce model for data-intensive processing tasks. Phoenix can be used to program multi-core chips as well as shared-memory multiprocessors (SMPs and ccNUMAs).  Phoenix was developed as a class project for the EE382a course at Stanford. The paper on Phoenix won the best paper award in the HPCA'07 conference.

About Phoenix 2

The initial version of Phoenix was released in the April of 2007. Since then it has been significantly updated to improve scalability and portability. Compared to the original release, version 2 includes:

• Linux (x86_64) support
• Enhanced NUMA support for Solaris environment
• Improved performance and stability

About Phoenix++

Phoenix++ is a C++ reimplementation of Phoenix 2. It is designed to provide a modular, extensible pipeline that can be easily adapted by the user to the characteristics of a particular workload.

Downloads

You have the following download options:

Phoenix++

• Source files: please download the input datasets from below as well.
  
  Version 1.0 (~2 MB)    
  MD5: 9246466b763a2c66a4eec8e9723e10d2

Phoenix 2

• Source files: please download the input datasets from below as well.
  
  Version 2.0.0 (~0.8 MB)    
  MD5: aa2e96fb3b242302762f9328fdf3272c

Phoenix (Original Release)

• The tiny package (~0.8 MB): it includes the Phoenix scheduler for MapReduce programming, some basic documentation, and the source code for 3 applications. These applications operate on randomly generated datasets.
  MD5: 250764506aa2045733516fc8dce4d835
  
  
• The regular package (~56 MB): everything in the tiny package plus 5 additional applications with small datasets for testing purposes.
  MD5: 2b0e41822d9fba266656393e688a1a18

Input Datasets

• Full input datasets for the sample applications: we provide small, medium, and large datasets for each application.
  
  histogram (~512 MB)
  MD5: da6e1853d22100b29590c0bb307b0251
  
  linear regression (~212 MB)
  MD5: d9ef0440ddb8b425bb9d6c2b89e62ee0
  
  string match (~212 MB)
  MD5: 32eb9fdc722e395a02add2b7cde6666d
  
  reverse index (~154 MB)
  MD5: 964568f6fca53aa4ae82539d798cd705
  
  word count (~59 MB)
  MD5: 903969c78d2dbd44357fdf7cbe750bc7

License

The Phoenix source code is distributed with a BSD license. The copyright is held by Stanford University. Phoenix is provided "as is" without any guarantees of any kind.

If you use Phoenix in your work or research, please let us know about it. We also encourage you to reference one of these papers:

Mailing List

We have created a mailing list for Phoenix users (phoenix-users@lists.stanford.edu). The goal is to provide a forum to communicate issues / fixes and exchange ideas about Phoenix and MapReduce programming in general. To receive the messages, please register. The messages are also archived. Note that the existence of the mailing list does not come along with support guarantees...

Related Projects

Below are some of the external projects / publications that use Phoenix.

• Tongping Liu, Charlie Curtsinger, and Emery D. Berger. "Dthreads: Efficient Deterministic Multithreading." In Proceedings of the 23rd ACM Symposium on Operating Systems Principles, 2011.


• Tongping Liu and Emery D. Berger. "Precise Detection and Automatic Mitigation of False Sharing." In Proceedings of the 26th Annual ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications, 2011


• Wei Jiang et al. "A Map-Reduce System with an Alternate API for Multi-Core Environments." In Proceedings of the 10th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing, 2010.


• Tongping Liu and Emery Berger. "Sheriff: Detecting and Eliminating False Sharing." Technical Report UMass TR UM_CS-2010-047, University of Massachusetts, Amherst.


• R. Chen et al. "Tiled-MapReduce: Optimizing Resource Usages of Data-parallel Applications on Multicore with Tiling." In Proceedings of the 19th International Conference on Parallel Architectures and Compilation Techniques, 2010.


• Adam Gordon. Elastic Phoenix. University of Alberta.


• Yandong Mao et al. "Optimizing MapReduce for Multicore Architectures." Technical Report MIT-CSAIL-TR-2010-020, MIT.


• Silas Boyd-Wickizer et al. "Corey: An Operating System for Many Cores." In Proceedings of the 8th Symposium on Operating Systems Design and Implementation, 2008

Credits

• Phoenix++ was developed by Justin Talbot and Richard Yoo.
• Phoenix 2 was developed by Richard Yoo and Anthony Romano.
• Original Phoenix code was developed by Colby Ranger, Ramanan Raghuraman, and Arun Penmetsa under the supervision of Christos Kozyrakis.
• Gary Bradski provided valuable feedback and the original version for some of the sample applications.
• Emery Berger provided a Linux port for the original Phoenix.

Contact Information

Please contact Christos Kozyrakis for further information. While we may not be able to provide technical support, let us know about bug reports and suggested improvements. If you make some correction or improvement to Phoenix, we would appreciate receiving a copy that we can include in the next release.

This page has been visited times since 5/2/2007.
Stats provided by the Free Hit Counter.