A gumtree crawler which finds flat shares within a particular reas.
Gumtree is an extensive network of online classifieds and community websites.
Gumtree now covers 60 cities across 6 countries - the UK, Ireland, Poland, Australia, New Zealand and South Africa. It is the UK's largest website for local community classifieds and was once one of the top 20 websites in the UK.
Read more about Gumtree here or visit the website here
This project is intended to find and filter (ones that you have already seen) flat shares within a particular area and display a list of links. The list will automatically update every 60 seconds to provide you a list of fresh links.
Good flats disappear quickly and most of the time it depends on you being one of the first persons to book a viewing. With this script you receive updates which happen on gumtree (within the area of interest) in real-time without requiring to constantly go through all the ads.
The program is a combination of a bash and python. To run the gum tree parser navigate to the downloaded source files and run the following command from your terminal.
./run.sh
The flatshares available within your area of interest will be displayed in the console (only shows status N items) and will be also saved in the file called 'file.txt' (Not so fancy!) so that you can view them later.
The flats are presented in this format.
<STATUS> <UNIQUE ID> <DESCRIPTION WITH LINK> <AREA>
The Status can be one of the following
N - New, This is a freshly retrieved flat share. This is the initial state.
S - Seen, Indicates that you have seen the flat and that you are not really interested.
T - Seen, Indicates that you have seen the flat and this one is shortlisted!
C - Contacted, Indicates that you have already contacts this owner by phone.
E - Emailed, Indicates that you have contacted this owner by email.
A sample output looks like this.
N leader-107138167 Large Double Room in Amazing Marchmont Flat - Ideal for Couples http://www.gumtree.com/p/flats-houses/large-double-room/107138167 "marchmont"
N leader-106357352 Student flatmate needed for great marchmont flat, preferably Spanish speaking! http://www.gumtree.com/p/flats-houses/student-flatmate-needed-for-great/106357352 "marchmont"
Now let us say that you have seen the flat with ID leader-107138167 and are happy with it, just change the status to T thus.
T leader-107138167 Large Double Room in Amazing Marchmont Flat - Ideal for Couples http://www.gumtree.com/p/flats-houses/large-double-room/107138167 "marchmont"
Note that this item will disappear from the console since the console filter items with a 'N' status.
In order the filter the areas which are being searched. Open the source folder and open the file called crawl.py.
You should be able to see the following section.
areas = [
"marchmont",
"bruntsfield",
]
In order to include an area of interest just add the area in inverted commas (without spaces all lowercase). Do not forget the comma. E.g. if we wanted to add 'tollcross' add this to the areas section.
areas = [
"marchmont",
"bruntsfield",
"tollcross",
]
In order to remove an area simply delete the entry.