Talk:Project 1

CS290F Fall 2006 - UCSB Computer Science - Thorsten von Eicken

Hi, For part B, we're suppose to fetch approximately 10,000 records and test how long that process would take. I don't know if this is a big deal or not but... if I do that, I'd be violating the "terms of use" as stated: You agree not to use or launch any automated system, including without limitation, "robots," "spiders," "offline readers," etc., that accesses the Website in a manner that sends more request messages to the YouTube servers in a given period of time than a human can reasonably produce in the same period by using a convention on-line web browser. What should I do? -Fred Softtacos 19:17, 16 October 2006 (PDT)

How will you get 100'000 records for the final project? For now, I'd try to fetch a record every 4 seconds. 10'000 * 4 = 40'000 seconds = 11-12 hours. TvE 20:01, 16 October 2006 (PDT)

I ended up putting a sleep in between requests of size 100. Didn't end up too bad. -Fred Softtacos 20:16, 16 October 2006 (PDT)