Big Data & Analytics

Agora

The project's purpose is to search for ads on websites. We scrape ads from all websites and create a hash of ad images in order to check check for identical images later. Then we scrape title, text, link of each ad. We get text of ads using the library, allowing retrieving only the main text from website. The web application was created to display information of scraped ads. There you can filter ads by date and other criteria.

CryptoCoin

The main idea was to develop an analytical service for traders (similar to Coinbase) with the possibility to create a personal portfolio to assess their own profits or losses and display their variation in real time. The main page contains graphs of currencies with a dynamic profit display (TOP-10 most popular crypto currencies in the world). You can get more detailed information on a certain crypto currency via search on a separate information page.

Statmetrix

We faced the challenge to create a platform for analyzing football matches for the team and for a certain player. The information on the site allows you to evaluate and compare the effectiveness of a football player or a team. In addition to information in figures (goals, passes, help, etc.), the service also provides visualization of events on the field. In this way, the user can select the most active sector of the field in one or another game.

ESI

The project purpose is to scrape news that is relevant to technology companies. We currently have three scrapers. Each scrapes news from different websites relevant to a specific company. You can search new by special tags to the most relevant news. The basic service was created to manage the scrapers. It's similar to ScrapingHub, but with fewer features. You can set the list of companies for scraping, run/stop any scraper, and check logs. There is also a feature that allows the scraper to run periodically.