Luke Y. Lu
Phone: 650-701-7078
Email:
LinkedIn: http://www.linkedin.com/in/lukelu
This URL: http://people.apache.org/~llu/cv.html

Summary

Inventor/creator of social search with PeopleRank. Key contributor of Apache Hadoop, Hypertable, Inktomi web search, Proofpoint MLX and Zvents search/analytics.

Specialties:

Algorithms and architectures for large scale information retrieval, distributed computing and storage, machine learning and web framework, UI and services for user generated content; multi-paradigm design and implementation.

Experience

Software Architect at IBM Corporation September 2011 - Present
  • Participate in the design and implementation of IBM Infosphere BigInsights product that brings big data analytics to enterprise leveraging the Hadoop stack and community.
  • Participate in customer enablement projects and support.
  • Contribute open source patches back to the community.
Hadoop Committer at Apache Software Foundation May 2011 - Present
  • Review, cleanup and commit patches.
  • Participate in community discussions.
Principal Engineer at Yahoo Inc. February 2010 - September 2011
  • Designed, implemented and deployed the next generation Hadoop metrics framework and instrumentation.
  • Designed and implemented the next generation Hadoop web framework, UI and services.
  • Participate in the design and implementation of the next generation Hadoop computing platform, aka MapReduce 2.0, while in the dev on-call rotation of the largest Hadoop clusters in the world.
Founder at Mountcloud June 2009 - February 2010
  • Hypertable development and consulting.
  • Helped founding Hypertable Inc.
Principal Architect at Zvents July 2007 - June 2009
  • Designed and implemented the federated and blended product search (with Ruby/Rails, Java/Solr.)
  • Participated in the design and implementation of Hypertable (with C++ servers and Ruby, PHP, Python, Perl, C/C++ and Java etc. clients): an open source distributed database inspired by Google's Bigtable. Authored coding conventions for the project.
  • Designed and implemented scalable CPC analytics for local advertising (with Java/Hadoop/Cascading and Hypertable.)
  • Introduced Git to the developement process.
  • Open source contributions accepted by: Thrift, Git, Review Board, KFS, Ceph
Founder, Chief Architect at Wink August 2004 - July 2007
  • Invented social search with PeopleRank.
  • Designed and implemented the initial social web search product (web front-end and back-end).
  • Helped raising venture funding with product demo and evangelizing before investors.
  • Led and participated in all phases of product (webapp, tag map, search engine) releases and operation.
  • Authored 3 pending patents.
  • Using: C++, PHP, Javascript (Ajax), Python, Java, Ice, MediaWiki, Apache, MySQL, Subversion, Linux
Senior Engineer at Proofpoint May 2003 - December 2004
  • Developed a novel message analysis and classification engine (MLX).
  • Developed corporate/HIPAA message compliance detection engine and web UI.
  • Using: C++, Perl, Apache, MySQL, CVS, Linux
Software Engineer III/IV, Technical Lead at Inktomi July 1999 - March 2003
  • Redesigned/Refactored/rewrote the entire web indexing tool-chain to support next generation index format and i18n (Unicode, CJK.)
  • Designed and implemented custom query support (query parsing and execution) in web search engine.
  • Helped growing index size from millions of docs to billions of docs.
  • Using: C/C++, Tcl, Perl, CVS, Solaris, Linux
Software Engineer at Landmark Graphics January 1996 - July 1999
  • Developed one of the first commercial parallel (message passing) simulation software for oil and gas industry.
  • Designed and implemented execution and monitoring (cross-platform desktop) GUI for the above simulator.
  • Developed doxygen like document generator for C/C++/MIDL.
  • Using: C/C++, Fortran, Tcl/Tk, Perl, ClearCase, MPI, AIX, Digital Unix, HP-UX, Irix, Solaris

Education

Master of Science in Petroleum Engineering, University of Texas at Austin
Bachelor of Science in Ocean Engineering, Shanghai Jiao Tong University