Web Scraping

[leafyon62]

Having just averted disaster, can I ask the BMR fellow members another question?

I noticed all sports betting data bases are web scraping proof.

I can understand ESPN, FOX SPORTS but Killer Sports too?

Has anyone tried a web scrape of some of their stats?

Not that I know how to do that, but maybe a certified programmer can.

Lot of questions from the new guy.

Thanks for the patience and excellent info.

 

[BobbyFK]

Justin7 would probably be the best person to help you out with this. Or even @KVB

 

[leafyon62]

Justin7 would probably be the best person to help you out with this. Or even @KVB

Thank you, Bobby.

 

[jjgold]

Get a programmer freelancer
Cheap

 

[Tanko]

I used to use Python programming to scrape the data. Lost touch with using it though.

Now I obtain the info off mosts sites by copying and pasting the data into Excel (if they don't have links the will download it already) and then use macros to reorganize/format it.

The initial setup is labor intensive and requries a lot of Excel skills but once its set up, its easy to use from year-to-year. Issues arise when sites change their layout/format (e.g. Betonline recently). Then I have to reprogram my macros to address the situation.

I would love to help you on this process but I have no free time during football season or NCAABB season.

I know I'm not much help but if you have any Excel skills its doable or you can learn Python programming.

 

[leafyon62]

I used to use Python programming to scrape the data. Lost touch with using it though.

Now I obtain the info off mosts sites by copying and pasting the data into Excel (if they don't have links the will download it already) and then use macros to reorganize/format it.

The initial setup is labor intensive and requries a lot of Excel skills but once its set up, its easy to use from year-to-year. Issues arise when sites change their layout/format (e.g. Betonline recently). Then I have to reprogram my macros to address the situation.

I would love to help you on this process but I have no free time during football season or NCAABB season.

I know I'm not much help but if you have any Excel skills its doable or you can learn Python programming.

Thank you so much, Tango.

 

[leafyon62]

Get a programmer freelancer
Cheap

Tried that recently, JJ Gold.

$45/hr. The man spent 2 hours programming only to find out what I already suspected.

TeamRankings (The data site I use) was immune to scraping.

Leary of hiring him again to try and scrape Killer Sports. Got a feeling they, and every other data site, are web scraping proof.

Thank you for the help, JJ Gold.

 

[Tanko]

Thank you so much, Tango.

Why do you call me Tango?
That's the 2nd time you've done that.

 

[leafyon62]

Why do you call me Tango?
That's the 2nd time you've done that.

My bad. Tanko.