Building a real estate market monitoring tool with Scrapy and TimescaleDB

Prices in real estate have jumped tremendously in the recent months and years in many countries. This is bad news if you are in the market for real estate. You need to be especially smart about how you search for listings, in order to find good opportunities. Luckily, if you are a developer who’s familiar with web data extraction, you can build your own tool to gather real estate market intelligence and find listings faster than others, or gain knowledge by exploring the market data.

During this talk, I’m going to show you an example how to build your own personal real estate market monitoring tool. I’m going to show how Scrapy and TimescaleDB can power a data exploration tool built with Apache Superset.

(This talk was given during Web Data Extraction Summit in 2021)