<ul><li style="text-align: justify;"><span style="font-family: Arial;">﻿</span><span style="font-family: Arial;">Experience running large-scale web scrapes</span></li><li style="text-align: justify;"><span style="font-family: Arial;">Solid Python knowledge</span></li><li style="text-align: justify;"><span style="font-family: Arial;">Familiarity with Linux/UNIX, HTTP, HTML, Javascript, and Networking</span></li><li style="text-align: justify;"><span style="font-family: Arial;">Familiarity with techniques and tools for crawling, extracting, and processing data(e.g. Scrapy, pandas, MapReduce, SQL, BeautifulSoup, etc).</span></li><li style="text-align: justify;"><span style="font-family: Arial;">Experience with system monitoring/administration tools</span></li><li style="text-align: justify;"><span style="font-family: Arial;">Experience with version control, open-source practices, and code review</span></li><li style="text-align: justify;"><span style="font-family: Arial;">Experience with applications designed to display archived web content</span></li></ul>