Xvideos database import

[rogerbit]

Hi
Xvideos provide thier entire database for free can you create a bot for it or help me upload it to my site

[rogerbit]

http://info.xvideos.com/db/
please refer above

[Punktured]

For FreeAdultScript to use the csv file of xvideos (which has over 500,000 videos),
it would require a complete rewrite of the FreeAdultScript core, mysql database and functions file.
Which would be a big task.

Even if it is done, it would then only allow embed codes,
which means it would still need more work to allow user (or admin) uploads.

The structure xvideos use is like this for their mysql:
link | title | time | thumbnail | embed | tags | category

- xvideos category goes by name, not ID like FreeAdultScript currently does.
- xvideos does not have a field for "Hits".
- Videos would also have to be identified by name rather than ID.
- FreeAdultScript stores tags in a seperate mysql table, but xvideos does not.
- FreeAdultScript stores "Saved" time (video ID), xvideos does not,
so you wouldnt be able to list videos by "Most Recent".
- All xvideos thumbnails would be hosted off server.

It may be possible to integrate both mysql's but that would still require an
almost complete rewrite of functions etc etc.

with some database changes and some well placed IF statements
within certain functions, it may be possible.

But I dont think this will be done any time soon,
mainly because alot of FreeAdultScript relies on the V_ID,
which xvideos does not have.

[telefuk]

Just extract the csv, import to excel and clean it up so that it only includes the right database fields.

It's a huge file to do but it's probably worth doing if you have the time and a beefy computer to handle it!

[Punktured]

even so,

you would have to edit FreeAdultScript "video" functions,
which isnt allowed at this time.

reason being:
admin gives this script for free as long as he can inject advertisements onto our video pages.

also, xvideos csv file doesnt have "video id" row, in their mysql, which would be needed for the "hit" row in freeadultscript.

[richdon03]

(20-03-2011 03:54 AM)telefuk Wrote:  Just extract the csv, import to excel and clean it up so that it only includes the right database fields.

It's a huge file to do but it's probably worth doing if you have the time and a beefy computer to handle it!

You can split it up into manageable chunks with this free CSV Splitter I just found. xVideo's database was up to 800K videos as of this morning, so the file is beyond huge. I used this splitter to break it up into 80 different files and cut and pasted them into an excel template that I use for my other script. I am using the database in another site of mine, starting today.

[Punktured]

it is definitely a worthy csv download,
i did find it many many duplicates tho.

[richdon03]

(26-07-2011 01:19 PM)Punktured Wrote:  it is definitely a worthy csv download,
i did find it many many duplicates tho.

I just found about 5 duplicates in the first 100 videos I imported to my other site. Gotta edit every title and description a bit to prevent problems with the big "G."