View Single Post
Old 03-25-2009, 04:18 PM   #56
Dom
I touch everything
Hardcore Gamer
 
Dom's Avatar
 
Join Date: Mar 2008
Posts: 946
Send a message via ICQ to Dom Send a message via AIM to Dom Send a message via MSN to Dom Send a message via Yahoo to Dom Send a message via Skype™ to Dom
Valve Steam ID: DomBlack Xbox Live Gamertag: Ph3nix
Twitter: DomBlack Dom's Facebook Digg: BluePhenix
Default

If you want to backup for yourself here is a python script I found eariler and modified slightly.

You will need Python lots of bandwidth and basicly a webserver to run it on. Just replace empireatwar with the subdomain of the site you want to rip (there are two occuances)

Code:
#!/usr/bin/env python
# A quick and VERY DIRTY filefront file ripper.
# LJ
import urllib
import os
import random



def getNames(sPage):
	""" Get a list of mod names from the page."""
	pPage = urllib.urlopen(sPage)
	
	# Find the link.
	print "Looking for links"
	lLines = pPage.readlines()
	lLinks = []
	for sLine in lLines:
			if "/file/" in sLine:
				lLinks.append(sLine)
	for sLink in lLinks:
		print sLink
	return lLinks
	
def doDownload(sPage, sFileName ="s"):
	""" Download a mod at a page with a gofetch link."""
	pPage = urllib.urlopen(sPage)
	
	# Find the link.
	print "Searching for Link"
	sDLine = None
	for sLine in pPage.readlines():
		if "gofetch" in sLine:
			sDLine = sLine.split("/file/gofetch/")[1].split("\"")[0]
			break
		elif "<big><b>Click here to Download the File</b></big></a>  </div><br>  <table summary=\"" in sLine:
			sName = sLine.split("<table summary=\"")[1].split("\"")[0]
			print sName
	if sDLine == "":
		return False
	
	# Download the file.
	print "Downloading Mod File."
	sModFile = "http://empireatwar.filefront.com/file/gofetch/" + sDLine
	
	sCommand = "wget --user-agent='Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.5) Gecko/2007071317 Firefox/2.0.0.5' --load-cookies=cookies.txt"
	os.popen((sCommand + " --output-document='"+sName+"_page.html' '" + sPage + "'") )
	os.popen((sCommand + " --output-document='"+sName+"' '" + sModFile + "'") )
	
	print "Done"
	return sModFile


def downloadCatagoryPage(sCatPath):
	""" Download a catagory page.   NOTE: ensure you set the number of things per-page to 100 and do each page by hand """
	lLinks = getNames(sCatPath)
	for sLink in lLinks:
		try:
			doDownload(sLink)
		except:
			"error downloading" + str(sLink)


## HERE WE DOWNLOAD THE PAGES WE WANT

# The rest of fed ships main
downloadCatagoryPage("http://empireatwar.filefront.com/sitemap_raw.txt")
__________________
Dom 'Phenix'
UberGames Developer

Ennoverse Web Hosting
http://www.ennoverse.com
http://www.ennoverse.co.uk
Affordable web hosting and domains.

A Division of UberNet Ltd.
Dom is offline   Reply With Quote