Comments for 5146 Games http://drmarcey.wordpress.com A Young Man's Primer on Sports Statistical Analysis Thu, 21 Aug 2008 22:48:02 +0000 http://wordpress.com/ hourly 1 Comment on Availability of Free NFL Statistics by Robi Ganguly http://drmarcey.wordpress.com/2007/12/04/availability-of-free-nfl-statistics/#comment-34 Robi Ganguly Thu, 21 Aug 2008 22:48:02 +0000 http://drmarcey.wordpress.com/2007/12/04/availability-of-free-nfl-statistics/#comment-34 We've been struggling with the same issues, not just for Football, but other sports as well (we just focused on the baseball season this year). In general, there are a lot of barriers to getting access to the statistics and we think it's causing a real lack of innovation around the data analysis. It stands to reason that if more people had access to the data, more people could come up with crazy and hopefully sometimes intriguing analysis. If you'd like to think up some ways to get around this or at least centralize the process of pulling and cleaning stats, feel free to reach out to us (just use my email). Dennis's comment might be a bit self-serving, but hell, if he's done what he says he has, it sounds like an interesting start right? Robi Ganguly http://draftmvp.com We’ve been struggling with the same issues, not just for Football, but other sports as well (we just focused on the baseball season this year). In general, there are a lot of barriers to getting access to the statistics and we think it’s causing a real lack of innovation around the data analysis. It stands to reason that if more people had access to the data, more people could come up with crazy and hopefully sometimes intriguing analysis. If you’d like to think up some ways to get around this or at least centralize the process of pulling and cleaning stats, feel free to reach out to us (just use my email). Dennis’s comment might be a bit self-serving, but hell, if he’s done what he says he has, it sounds like an interesting start right?

Robi Ganguly
http://draftmvp.com

]]> Comment on About by Rohit http://drmarcey.wordpress.com/about/#comment-32 Rohit Fri, 11 Jul 2008 00:40:57 +0000 #comment-32 Hi Derrick, Just looked at the XML file that you had generated for the 2006 nfl season. It was awesome. A couple of questions. 1.) Do you have a utility that parses a website like cnn.com/si or espn.com and then generates this xml file? I am currently working on a similar problem. I am trying to parse data off of a webpage in real time ..and the biggest problem I have is that I cant parse the data. Any help / suggestions that you may provide will be appreciated. Thanks, Rohit Hi Derrick,
Just looked at the XML file that you had generated for the 2006 nfl season. It was awesome. A couple of questions.

1.) Do you have a utility that parses a website like cnn.com/si or espn.com and then generates this xml file?

I am currently working on a similar problem. I am trying to parse data off of a webpage in real time ..and the biggest problem I have is that I cant parse the data.

Any help / suggestions that you may provide will be appreciated.

Thanks,
Rohit

]]> Comment on XML Box Scores Now Available by Fantasy News http://drmarcey.wordpress.com/2007/12/14/xml-box-scores-now-available/#comment-31 Fantasy News Thu, 03 Jul 2008 02:55:37 +0000 http://drmarcey.wordpress.com/2007/12/14/xml-box-scores-now-available/#comment-31 The sample sheets look great. However, it abbreviates the first name of each player. . . Why? That makes it harder to add to a database to keep track of things. I suppose the nfl.com boxscore must abbreviate the first name as well? If that is the case. . then parsing nfl.com might not be the best route to go . . What language is it coded in? I would love to take a look because I was just about to purchase the nfl boxscore package at xmlteam. . .so this may be a better route :) Please keep us updated! I can smell football around the corner The sample sheets look great. However, it abbreviates the first name of each player. . . Why? That makes it harder to add to a database to keep track of things.

I suppose the nfl.com boxscore must abbreviate the first name as well? If that is the case. . then parsing nfl.com might not be the best route to go . .

What language is it coded in? I would love to take a look because I was just about to purchase the nfl boxscore package at xmlteam. . .so this may be a better route :)

Please keep us updated! I can smell football around the corner

]]> Comment on Availability of Free NFL Statistics by Paul http://drmarcey.wordpress.com/2007/12/04/availability-of-free-nfl-statistics/#comment-27 Paul Mon, 05 May 2008 16:02:09 +0000 http://drmarcey.wordpress.com/2007/12/04/availability-of-free-nfl-statistics/#comment-27 Sure the spreadsheet is yours for $0, as long as you subscribe to the site for $99. Sure the spreadsheet is yours for $0, as long as you subscribe to the site for $99.

]]> Comment on XML Box Scores Now Available by Steve http://drmarcey.wordpress.com/2007/12/14/xml-box-scores-now-available/#comment-26 Steve Sun, 20 Apr 2008 23:59:43 +0000 http://drmarcey.wordpress.com/2007/12/14/xml-box-scores-now-available/#comment-26 I too decided in 2007 to scrape the box scores from NFL.Com to use in a neural network. My parser is set up to select the box scores for any given week in any season, or an entire season's worth if available on nfl.com. Basically my steps are: 1. gather the schedules in text format 2. let the PC format them as XML 3. select the schedule to fetch box scores for 4. iterate through the HTML, in memory, and output the box scores week by week and for a full season as xml. 5. Then I am able to use this data to complete calculations and format the select stats for a neural network as well. I did all of my work in C# in VS 2003. I have since ported it to VS 2008. Very interesting. Keep it up. I too decided in 2007 to scrape the box scores from NFL.Com to use in a neural network. My parser is set up to select the box scores for any given week in any season, or an entire season’s worth if available on nfl.com.

Basically my steps are:
1. gather the schedules in text format
2. let the PC format them as XML
3. select the schedule to fetch box scores for
4. iterate through the HTML, in memory, and output the box scores week by week and for a full season as xml.
5. Then I am able to use this data to complete calculations and format the select stats for a neural network as well.

I did all of my work in C# in VS 2003. I have since ported it to VS 2008.

Very interesting. Keep it up.

]]> Comment on Availability of Free NFL Statistics by Dennis http://drmarcey.wordpress.com/2007/12/04/availability-of-free-nfl-statistics/#comment-25 Dennis Sat, 22 Mar 2008 01:28:52 +0000 http://drmarcey.wordpress.com/2007/12/04/availability-of-free-nfl-statistics/#comment-25 I hear you on the lack of decent NFL stats in a work-able format. My answer to the problem was to develop an Excel program that parses NFL game-books and dumps 130+ stats per-game into a separate spreadsheet. Many of these stats are from the actual play-by-plays of the game. If you are interested, visit my site at http://www.armchairanalysis.com/sample-nfl-database.html. The complete spreadsheet is yours if you want it ($0), with data going as far back as '94. Regards, Dennis I hear you on the lack of decent NFL stats in a work-able format.

My answer to the problem was to develop an Excel program that parses NFL game-books and dumps 130+ stats per-game into a separate spreadsheet. Many of these stats are from the actual play-by-plays of the game.

If you are interested, visit my site at http://www.armchairanalysis.com/sample-nfl-database.html. The complete spreadsheet is yours if you want it ($0), with data going as far back as ‘94.

Regards,
Dennis

]]> Comment on NFL “Official” Analysis by BradH http://drmarcey.wordpress.com/2007/12/06/nfl-official-analysis/#comment-23 BradH Fri, 15 Feb 2008 18:33:10 +0000 http://drmarcey.wordpress.com/2007/12/06/nfl-official-analysis/#comment-23 Hi, I just came across your blog. I hope you are still working on this project, because I think it's important. If you were a student at mu university, I'd hire you in a minute to do this work. In terms of what to do with these data when you get them collected, you could look at the Journal of Quantitative Analysis in Sport http://www.bepress.com/jqas/ or the Journal of Sports Economics http://jse.sagepub.com/ for some ideas. Or email me for some suggestions. Brad Hi,

I just came across your blog. I hope you are still working on this project, because I think it’s important. If you were a student at mu university, I’d hire you in a minute to do this work.

In terms of what to do with these data when you get them collected, you could look at the Journal of Quantitative Analysis in Sport

http://www.bepress.com/jqas/

or the Journal of Sports Economics

http://jse.sagepub.com/

for some ideas. Or email me for some suggestions.

Brad

]]> Comment on XML Box Scores Now Available by SportsPicksSystem http://drmarcey.wordpress.com/2007/12/14/xml-box-scores-now-available/#comment-19 SportsPicksSystem Thu, 27 Dec 2007 04:43:30 +0000 http://drmarcey.wordpress.com/2007/12/14/xml-box-scores-now-available/#comment-19 Hello, I tried to open the file atl-car.xml from week1 directory. The game-metadata tag is never closed. I think this problem occurs in every files. Do you have the same problem? Anyway great work. Sports Picks System Hello,

I tried to open the file atl-car.xml from week1 directory. The game-metadata tag is never closed. I think this problem occurs in every files. Do you have the same problem? Anyway great work.

Sports Picks System

]]> Comment on XML Box Scores Now Available by Brian http://drmarcey.wordpress.com/2007/12/14/xml-box-scores-now-available/#comment-18 Brian Fri, 14 Dec 2007 23:13:34 +0000 http://drmarcey.wordpress.com/2007/12/14/xml-box-scores-now-available/#comment-18 Very cool. Keep up the great work. Very cool. Keep up the great work.

]]> Comment on NFL Box Score XML Format by XML Box Scores Now Available « 5146 Games http://drmarcey.wordpress.com/2007/11/29/nfl-box-score-xml-format/#comment-17 XML Box Scores Now Available « 5146 Games Fri, 14 Dec 2007 21:49:50 +0000 http://drmarcey.wordpress.com/2007/11/29/nfl-box-score-xml-format/#comment-17 [...] all of the games played in that week. The format is very similar to the one mentioned here, NFL Box Score XML Format, with a few additions found in the gamebook for the [...] [...] all of the games played in that week. The format is very similar to the one mentioned here, NFL Box Score XML Format, with a few additions found in the gamebook for the [...]

]]>