Long time to backup

General discussion about Train Simulator, your thoughts, questions, news and views!

Moderator: Moderators

Locked
RudolfJan
Well Established Forum Member
Posts: 523
Joined: Thu Oct 18, 2007 6:40 pm

Long time to backup

Post by RudolfJan »

Hi all,

I just ordered a new computer :P and so I need to copy my 55Gb TS2013 data. Yesterday I started to make a backup to a network disk. The system is transferring the data over my 1Gbit/s network at a speed of about 100kbyte/s, so using 0.2% of the capacity.

I idea how I can speed it up? It doesn't seem to be a networking problem. Also plenty of processor capacity and RAM.
Rudolf

http://www.hollandhiking.nl/trainsimulator
Here you will find the latest version of the Senario Authors Guide, TSW starters Guide, LuaCreator and TSWTools and more ...
User avatar
alanch
Very Active Forum Member
Posts: 4907
Joined: Mon Feb 27, 2006 6:07 pm
Location: Leeds, England
Contact:

Re: Long time to backup

Post by alanch »

It's probably a Windows problem -try doing the transfer in a Command window using XCopy, and see if that speeds it up.
Alan

My railway photos are now on Google + - links to the albums are in this thread http://forums.uktrainsim.com/viewtopic. ... 9&t=149558

Lots of steam and early diesels from 1959 to 1963.
User avatar
749006
Very Active Forum Member
Posts: 9862
Joined: Fri Mar 30, 2012 11:17 am
Location: England
Contact:

Re: Long time to backup

Post by 749006 »

Would it be easier to just copy to a Portable Drive.
Not reliant on network connections - just USB.

Peter
http://peter749.piwigo.com/
My Railway Pictures
RudolfJan
Well Established Forum Member
Posts: 523
Joined: Thu Oct 18, 2007 6:40 pm

Re: Long time to backup

Post by RudolfJan »

Thanks for your replies! I finally decided just to be patient. When finished I made a backup of another huge game, 20Gb. This one performed much better at a transfer speed of 29Mbyte/s which is quite reasonable. So my conclusion is that the real problem is in hard disk access time. It doesn't help that TS2013 consists of over 300.000 mostly small files.

So what may help is software with a much faster disk access. No idea if this exists. The idea to use a USB drive I tried in the past, but it doesn't help.
Rudolf

http://www.hollandhiking.nl/trainsimulator
Here you will find the latest version of the Senario Authors Guide, TSW starters Guide, LuaCreator and TSWTools and more ...
User avatar
Juanillo99
Well Established Forum Member
Posts: 879
Joined: Sat Oct 13, 2012 5:12 pm
Location: Teruel - Spain
Contact:

Re: Long time to backup

Post by Juanillo99 »

The cause of this slow transfer may also be because Railworks files are highly fragmented. Try defragmenting the Railworks directory. There is a program that, in addition to defrag your entire hard drive, also offers the option to defragment individual directories.
It's called Defraggler, and you can download it here → http://www.piriform.com/defraggler

PS: Defragment periodically the simulator influences an improvement in performance.
My Spanish website dedicated to Train Simulator 2019: https://ferrosim.es
Image
User avatar
trainsmit
Been on the forums for a while
Posts: 286
Joined: Sat Sep 26, 2009 12:24 pm

Re: Long time to backup

Post by trainsmit »

Many small files on a network disk will be slower than larger files on a local disk. Some of the problem is configuration of diskserver ressources. Fragmentation of the destination disk is also a factor.

When space permits making an archive file locally and then move that, may improve transfer time.
Smile when ...
User avatar
ttjph
Very Active Forum Member
Posts: 1454
Joined: Mon Jun 27, 2011 11:54 am
Location: Warwickshire

Re: Long time to backup

Post by ttjph »

trainsmit wrote:When space permits making an archive file locally and then move that, may improve transfer time.
I once tried zipping my RW installation using the built-in Windows software. Unfortunately, whilst it seemed fast at first it soon became apparent that it was re-writing the entire .zip file for every file it added... which made it terminally slow before it finished.

Do other file compression utilities manage this better than Windoze?
i5-4690k | 16 GB | GTX970 | Win 10 64bit | h/k SoundSticks | 1680x1050
User avatar
alanch
Very Active Forum Member
Posts: 4907
Joined: Mon Feb 27, 2006 6:07 pm
Location: Leeds, England
Contact:

Re: Long time to backup

Post by alanch »

If you have plenty of storage space, I'd recommend Microsoft Synctoy for backup - once you have backed up the first time which will take some time, Synctoy only looks for differences on subsequent back ups, and so is much faster. No compression, but three options for the type of backup, and you can choose which folders/files to include.

Synctoy is free from http://www.microsoft.com/en-us/download ... x?id=15155
Alan

My railway photos are now on Google + - links to the albums are in this thread http://forums.uktrainsim.com/viewtopic. ... 9&t=149558

Lots of steam and early diesels from 1959 to 1963.
User avatar
ttjph
Very Active Forum Member
Posts: 1454
Joined: Mon Jun 27, 2011 11:54 am
Location: Warwickshire

Re: Long time to backup

Post by ttjph »

One limitation I found when I looked at Synctoy was that it identifies individual USB drives. Since my backup routine consists of three USB sticks in rotation (two in safe storage and one at home waiting for the next backup), this didn't play well.

xcopy and robocopy have options which achieve the same thing, if you like batch files...
i5-4690k | 16 GB | GTX970 | Win 10 64bit | h/k SoundSticks | 1680x1050
User avatar
alanch
Very Active Forum Member
Posts: 4907
Joined: Mon Feb 27, 2006 6:07 pm
Location: Leeds, England
Contact:

Re: Long time to backup

Post by alanch »

ttjph wrote:One limitation I found when I looked at Synctoy was that it identifies individual USB drives. Since my backup routine consists of three USB sticks in rotation (two in safe storage and one at home waiting for the next backup), this didn't play well.
Couldn't you have just created three backup jobs in Synctoy - one for each drive?
Alan

My railway photos are now on Google + - links to the albums are in this thread http://forums.uktrainsim.com/viewtopic. ... 9&t=149558

Lots of steam and early diesels from 1959 to 1963.
Locked

Return to “[TS] General Discussion”