Skip to content

Triangle Python Users Group: TriPython (formerly TriZPUG)

Sections
Personal tools
You are here: Home » Members » cbc's Home » TriPython October 2016 Meeting: Engineering a Robust(ish) Data Pipeline with Luigi and AWS Elastic Map Reduce

TriPython January, April, July, and October general meetings and monthly second Wednesday project nights meet at:

UNC Renaissance Computing Institute

TriPython February, May, August, and November general meetings and monthly first Tuesday project nights meet at:

WebAssign: Online Homework and Grading

TriPython March, June, September, and December general meetings and monthly third Monday project nights meet at:

Caktus Consulting Group
Log in
 

TriPython October 2016 Meeting: Engineering a Robust(ish) Data Pipeline with Luigi and AWS Elastic Map Reduce

Document Actions
Note that this meeting is on the third Thursday of the month for this month only due to a conflict with the closing parties at the All Things Open conference. With great data comes great responsibility. In this talk, we'll look at how to build a data reporting pipeline that's reliable, scalable, and maintainable. This will involve Luigi, a simple but powerful tool for managing interdependent batch processes. We'll also look at using the Datapipeline and EMR services in AWS. This talk is by Aaron Knight. Aaron is a full-stack engineer at Voxy, an education startup that creates English lessons that are personalized to a learner's interests and goals. He is also the organizer of the weekly Triangle Hacker Hours meetup. Extemporaneous "lightning talks" of 5-10 minute duration are also welcome and don't need to be pre-announced. Lightning talks are for you to "show and tell" something you've learned about Python recently, no matter how small. We all use Python, therefore, we are always learning something new about Python that we can tell others. Plenty of free parking is available in the RENCI parking deck. The meeting will be followed by our usual after-meeting at a nearby tavern for food and beverage. Come join us for a fun and informative evening.

For more information, visit
http://renci.org/about/locations/

What
Meeting
When
2016-10-20 from 19:00 to 21:00
Where
Renaissance Computing Institute (RENCI), Biltmore Conference Room, 5th Floor, 100 Europa Drive, Suite 590, Chapel Hill
Name
Chris Calloway
Contact Email
cbc@unc.edu
Contact Phone
(919) 599-3530

September 14-16, 2016:

PyData Carolinas 2016

TriPython endorses:

PyLadies RDU

Upcoming Events
Durham Project Night
Caktus Group Tech Space, 108 Morris St., Durham,
2017-07-17
TriPython July 2017 Meeting: Just What Is A Quality Engineer?
Renaissance Computing Institute (RENCI), Biltmore Conference Room, 5th Floor, 100 Europa Drive, Suite 590, Chapel Hill,
2017-07-27
Raleigh Project Night
WebAssign, NCSU Centennial Campus, 1791 Varsity Drive, Suite 200, Raleigh,
2017-08-01
Chapel Hill Project Night
Renaissance Computing Institute (RENCI), Biltmore Conference Room, 5th Floor, Europa Center, 100 Europa Drive, Suite 590, Chapel Hill,
2017-08-09
« June 2017 »
Su Mo Tu We Th Fr Sa
        1 2 3
4 5 6 7 8 9 10
11 12 13 14 15 16 17
18 19 20 21 22 23 24
25 26 27 28 29 30  
2017-06-06
18:00-21:00 Raleigh Project Night
2017-06-14
18:00-21:00 Chapel Hill Project Night
2017-06-19
18:00-21:00 Durham Project Night
2017-06-22
19:00-21:00 TriPython June 2017 Meeting: HoneyPy
Orders over $29.95 qualify for free shipping in the US.