Running out of memory

[slipperman12]

Hi All,
Recently, as a result of a conversation in an MSTS thread, I've been testing a long activity (057 Down Manchester Pullman) in the Thames - Mersey route. About an hour and a half into the act, various missing sms messages were displayed and some scenery and track textures were not being displayed.

It appears that OR has the same problem in that after about the same length of time, AI trains and some station buildings have just a grey texture! At the same time, the Key display (throttle, brake, F6, etc) weren't shown on the screen, although they did still work; also, the screen capture didn't work. The run was able to continue for about another 20 minutes until a "Stopped Working" message was displayed.

This has been reported to OpenRails (bug 1206693) and I have received a reply that it's very similar to a bug already reported (1191966), also involving a resource heavy route. Apparently, it is because of the 2GB limit applicable to 32 bit programs - OR uses 32 bit elements within it's construction. Unfortunately, saves being currently taken (at least on my setup) are reported as invalid and unable to be used; they MAY have solved this problem.
I ran the Large Address Aware (laa) program to set the flag in OpenRails.exe in the hope that it may help .... it didn't

It would seem that we are stuck with this problem, unless OR can be made completely 64 bit! In the shorter term, solving the 'save' problem may give a way out of it.

This is not a plea for help, but a report on my experiences. However, I would be interested to hear of others having similar problems.

An afterthought - I wonder if applying the LAA to RunActivity.exe instead of OpenRails.exe would help ? Stay tuned for my next report

Cheers,
Ged

[twpol]

It would seem that we are stuck with this problem, unless OR can be made completely 64 bit! In the shorter term, solving the 'save' problem may give a way out of it.

While making OR 64bit is a good solution - that we currently can't make use of - it is by no means the only option. For a start, the fact that when you run out of resources saving and reloading (when it worked) returns the memory usage to a lower level means we are leaking something. I just need to figure out what.

Also, OR is quite simple-minded about mesh and texture loading; for example, all LODs of an object are loaded immediately and always kept around for the lifetime of the shape. That's unnecessary memory usage in a lot of cases.

An afterthought - I wonder if applying the LAA to RunActivity.exe instead of OpenRails.exe would help ? Stay tuned for my next report

Yeah, RunActivity.exe is the "game engine" and is the one that would benefit from the LAA flag. In theory it'll give you ~3.5GB of usable address space but it may vary due to other factors.

[slipperman12]

Hi James,
Thanks for your reply.

I have answered my own question! I applied LAA to RunActivity.exe and was able to run the complete activity (almost two and a half hours due to differences between MSTS and ORTS). As far as I could see, no textures were missed, and more importantly, no error messages were displayed on the log!
The only difference between this run and my previous, non-LAA, run is that this time I didn't take any saves. Would that make a difference? For my own satisfaction, I'll be rerunning the activity tomorrow, taking saves at the same locations as in the first run

The use of LAA is very straight-forward for 64 bit OS users, but I believe it's a little more complicated if you're running 32 bit.

Cheers,
Ged

[slipperman12]

Hi,
As I hoped, the taking of saves didn't affect the running of the same activity with an LAA-enhanced RunActivity.exe, although, as previously reported, saves cannot currently be used to resume an act.

I had a problem when I first ran the Activity today - no changes have been made since yesterday's successful run. After running only a few minutes, the following was reported :

Error: System.ArgumentOutOfRangeException: When drawing indexed primitives, the number of vertices passed in must be greater than zero.
Parameter name: numVertices
at Microsoft.Xna.Framework.Graphics.GraphicsDevice.DrawIndexedPrimitives(PrimitiveType primitiveType, Int32 baseVertex, Int32 minVertexIndex, Int32 numVertices, Int32 startIndex, Int32 primitiveCount)
at ORTS.ParticleEmitter.Draw(GraphicsDevice graphicsDevice)
at ORTS.ParticleEmitterMaterial.Render(GraphicsDevice graphicsDevice, IEnumerable`1 renderItems, Matrix& XNAViewMatrix, Matrix& XNAProjectionMatrix)
at ORTS.RenderFrame.DrawSequences(GraphicsDevice graphicsDevice, Boolean logging)
at ORTS.RenderFrame.DrawSimple(GraphicsDevice graphicsDevice, Boolean logging)
at ORTS.RenderFrame.Draw(GraphicsDevice graphicsDevice)
at ORTS.RenderProcess.Draw()
at ORTS.RenderProcess.Draw(GameTime gameTime)
at Microsoft.Xna.Framework.Game.DrawFrame()
at Microsoft.Xna.Framework.Game.Tick()
at Microsoft.Xna.Framework.Game.HostIdle(Object sender, EventArgs e)
at Microsoft.Xna.Framework.GameHost.OnIdle()
at Microsoft.Xna.Framework.WindowsGameHost.ApplicationIdle(Object sender, EventArgs e)
at System.Windows.Forms.Application.ThreadContext.System.Windows.Forms.UnsafeNativeMethods.IMsoComponent.FDoIdle(Int32 grfidlef)
at System.Windows.Forms.Application.ComponentManager.System.Windows.Forms.UnsafeNativeMethods.IMsoComponentManager.FPushMessageLoop(Int32 dwComponentID, Int32 reason, Int32 pvLoopData)
at System.Windows.Forms.Application.ThreadContext.RunMessageLoopInner(Int32 reason, ApplicationContext context)
at System.Windows.Forms.Application.ThreadContext.RunMessageLoop(Int32 reason, ApplicationContext context)
at System.Windows.Forms.Application.Run(Form mainForm)
at Microsoft.Xna.Framework.WindowsGameHost.Run()
at Microsoft.Xna.Framework.Game.Run()
at ORTS.Viewer3D.Run(BinaryReader inf)
at ORTS.Program.Start(UserSettings settings, String[] args)
at ORTS.Program.<>c__DisplayClass6.<Main>b__3()
at ORTS.Program.Main(String[] args)

It may be due to a file being mis-read, or maybe my A/V was busy (!), because the second run was successful.

Cheers,
Ged

[dennisat]

.. saves cannot currently be used to resume an act...Ged

Hi,

I've been running this act as well and it resumes from saves OK. What version are you using? I'm using X1705.

Dennis

[slipperman12]

Hi Dennis,
This looks like my 3000th post

I'm using x 1705. I have also tried a save/resume using new versions of OpenRails.exe and RunActivity.exe (ie not ones I used LAA on) and the Resume still fails with the message :

Error: System.FormatException: Too many bytes in what should have been a 7 bit encoded Int32.
at System.IO.BinaryReader.Read7BitEncodedInt()
at System.IO.BinaryReader.ReadString()
at ORTS.RollingStock.Restore(Simulator simulator, BinaryReader inf, Train train)
at ORTS.Train.RestoreCars(Simulator simulator, BinaryReader inf)
at ORTS.Train..ctor(Simulator simulator, BinaryReader inf)
at ORTS.Simulator.RestoreTrains(BinaryReader inf)
at ORTS.Simulator.Restore(BinaryReader inf, Single initialTileX, Single initialTileZ)
at ORTS.Program.Resume(UserSettings settings, String[] args)
at ORTS.Program.<>c__DisplayClass6.<Main>b__3()
at ORTS.Program.Main(String[] args)

I am using the CD version of Thames - Mersey v4.3

One thing I noticed is that OpenRails takes more than 2 minutes to start this route - understandable, I suppose, due to its size!

Save / Resume works OK on the default Settle & Carlisle route

Cheers,
Ged

[dennisat]

Hi,

I've only tried saving and resuming from Watford, perhaps the problem occurs further down the line. I'll carry on driving when I've got time. The error message appears to relate to restoring rolling stock, perhaps an OR developer could confirm this.

Have you noticed messages in the log:
"Warning: Some of this STF file was not parsed. in D:\Program Files (MSTS)\Microsoft Games\Train Simulator\trains\trainset\UK_Electric_BR_EMU_Cl501_B\501_lmr_emu_b_ts.wag:line 46"
There are two wag files (so far) that I've encountered that raise this message and they both have two misplaced brackets in them. I noticed passing an AI Class 501, the units with the bad wag files, with gaps where the carriages should have been. However, my restores work both with and without the correction.

I also have, so far, a bad shape file:
"Warning: Car with less than two axles/bogies (3 axles, 2 bogies) in D:\Program Files (MSTS)\Microsoft Games\Train Simulator\trains\trainset\UK_Electric_BR_EMU_Cl310\310emucar2.wag"
This can be only a warning but in this case the carriage should have two bogies with two axles each. I can usually correct this with Shape File Manager but looking at the shape file, the fault doesn't seem to be as simple as usual.

I'm losing count of the number of dud wag, eng and shape files detected by OR that I've corrected. It amazes me how MSTS managed to work sometimes, it must have a very comprehensive set of defaults to fall back on when it finds bad files. Pity it never told you they were bad. I think some performance differences between OR and MSTS are due to the way each sim deals with illogical and inconsistent parameters.

Dennis

[slipperman12]

Hi Dennis,
I've tried saving just after leaving Euston, with the same result!

Regarding the "STF file was not parsed" message, I found those two and corrected them - still no luck

I have seen several "3 axles, 2 bogies" messages, but not been able to determine why it's displayed.

I wondered if my problems are because of the sheer volume of data in the route, so I ran it through Train Store first to remove all the unwanted files for this activity - it made absolutely no difference!!

Cheers,
Ged

[dennisat]

Hi,

It may be worth checking for major differences between our systems. For comparison, my system is self-built:

AMD Phenom II x 4 965 - 3.41GHz
8GB RAM
Nvidia GTX460 1Gb Graphics Card
2 x 500GB Western Digital WD5000AAKX (not RAID) - MSTS and Open Rails not on Windows System disk
Creative X-Fi Xtreme Music Sound Card (rather old, but it still works!)
Windows 7 Pro 64 bit

I've also attached my "resume" log below, it may be worth checking for significant differences.

Dennis

Open Rails is starting...
Argument 0 = -resume
Argument 1 = C:\Users\Dennis\AppData\Roaming\Open Rails\tm_057_br_ms_down_manchester_pullman 2013-08-14 19.22.48.save
Version = X.1705
Build = 0.0.4967.32076 (2013-08-07 17:49:12Z)
Logfile = C:\Users\Dennis\Desktop\OpenRailsLog.txt
--------------------------------------------------------------------------------
AdhesionMovingAverageFilterSize = 10
Alerter = False
AvatarURL = http://openrails.org/images/support-logos.jpg
BrakePipeChargingRate = 21
BreakCouplers = False
Cab2DStretch = 0
CarVibratingLevel = 0
DataLogger = False
DataLoggerSeparator = comma
DataLogMisc = False
DataLogPerformance = True
DataLogPhysics = False
DataLogSpeedUnits = route
DataLogStart = False
DistantMountains = False
DistantMountainsLoweringValue = 5
DistantMountainsViewingTiles = 20
DoubleWire = False
DynamicShadows = (registry) True
FullScreen = False
GraduatedRelease = False
LoadingDelay = (registry) 10
LODViewingExtention = False
Logging = True
LoggingFilename = OpenRailsLog.txt
LoggingPath = C:\Users\Dennis\Desktop
Menu_Selection = (registry) D:\Program Files (MSTS)\Microsoft Games\Train Simulator, D:\Program Files (MSTS)\Microsoft Games\Train Simulator\ROUTES\Mersey, D:\Program Files (MSTS)\Microsoft Games\Train Simulator\ROUTES\Mersey\ACTIVITIES\tm_057_br_ms_down_manchester_pullman.act
MSTSBINSound = (registry) True
Multiplayer = False
Multiplayer_Host = 127.0.0.1
Multiplayer_Port = 30000
Multiplayer_UpdateInterval = 10
Multiplayer_User = Dennis
MultiplayerClient = False
MultiplayerServer = False
Precipitation = (registry) True
Profiling = False
ProfilingFrameCount = 0
ProfilingTime = 0
ReplayPauseBeforeEnd = True
ReplayPauseBeforeEndS = 0
ScreenshotPath = C:\Users\Dennis\Pictures\Open Rails
ShaderModel = 0
ShadowAllShapes = (registry) True
ShadowMapBlur = (registry) False
ShadowMapCount = (registry) 1
ShadowMapDistance = 0
ShadowMapResolution = (registry) 6144
ShowAvatar = False
ShowErrorDialogs = True
SoundDetailLevel = 5
SoundVolumePercent = (registry) 30
SuperElevationGauge = 1435
SuperElevationMinLen = (registry) 100
SuppressConfirmations = False
TrainLights = (registry) True
UseAdvancedAdhesion = True
UseSuperElevation = (registry) 8
VerticalSync = (registry) True
ViewDispatcher = (registry) True
ViewingDistance = 2000
ViewingFOV = 45
WindowGlass = (registry) True
WindowPosition_Activity = (registry) 0, 50
WindowPosition_Compass = (registry) 0, 0
WindowPosition_ComposeMessage = (registry) 0, 50
WindowPosition_DriverAid = 100, 100
WindowPosition_Help = (registry) 0, 42
WindowPosition_NextStation = (registry) 0, 95
WindowPosition_Quit = (registry) 0, 50
WindowPosition_Switch = 0, 50
WindowPosition_TrackMonitor = 100, 0
WindowPosition_TrainOperations = (registry) 0, 21
WindowSize = (registry) 1280x1024
Wire = (registry) True
WorldObjectDensity = 10
--------------------------------------------------------------------------------
Mode = Resume Activity
Activity = D:\Program Files (MSTS)\Microsoft Games\Train Simulator\ROUTES\Mersey\ACTIVITIES\tm_057_br_ms_down_manchester_pullman.act
--------------------------------------------------------------------------------
Loading TRK TDB

Warning: Track node pin has invalid link 0 in D:\Program Files (MSTS)\Microsoft Games\Train Simulator\ROUTES\Mersey\Mersey.tdb:line 3358

Warning: Track node pin has invalid link 0 in D:\Program Files (MSTS)\Microsoft Games\Train Simulator\ROUTES\Mersey\Mersey.tdb:line 19682

Warning: Track node pin has invalid link 0 in D:\Program Files (MSTS)\Microsoft Games\Train Simulator\ROUTES\Mersey\Mersey.tdb:line 84948

SIGCFG DAT ACT RDB

Warning: Track node pin has invalid link 0 in D:\Program Files (MSTS)\Microsoft Games\Train Simulator\ROUTES\Mersey\Mersey.rdb:line 80269

Warning: Track node pin has invalid link 0 in D:\Program Files (MSTS)\Microsoft Games\Train Simulator\ROUTES\Mersey\Mersey.rdb:line 105481

Warning: Track node pin has invalid link 0 in D:\Program Files (MSTS)\Microsoft Games\Train Simulator\ROUTES\Mersey\Mersey.rdb:line 113640

Warning: Track node pin has invalid link 0 in D:\Program Files (MSTS)\Microsoft Games\Train Simulator\ROUTES\Mersey\Mersey.rdb:line 114912

CARSPAWN SIGSCR
WWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWW


Warning: Invalid crossover : indices 2318 and 2319 : equal section : 2255

Warning: Incomplete crossover : indices 2332 and 2331

Warning: Invalid crossover : indices 2021 and 2022 : equal section : 3694

Warning: Incomplete crossover : indices 3119 and 3118

Warning: Incomplete crossover : indices 17218 and 17217

Warning: Incomplete crossover : indices 78 and 75

Warning: Section 334, Pin [0,0] is 0 reference

Warning: Section 2000, Pin [0,0] is 0 reference

Warning: Section 8485, Pin [0,0] is 0 reference

Warning: Section 12824, Pin [1,0] links to section 2088 already linked by 12824

Information: Platform split by junction at Birkenhead Park

Information: Platform split by junction at Bankhall Sidings

Information: Platform split by junction at W.P. Hartley's Sidings

Information: Platform split by junction at Bridge Street Goods Yard

Information: Platform split by junction at Edge Hill No.12 Box

Information: Platform split by junction at Crewe North MPD (5A)

Information: Platform split by junction at McGregor Distribution Depot

ENV SIGCFG TTYPE

Warning: Skipped track section 6730 not in global or dynamic TSECTION.DAT

Information: OpenAL 1.1 ALSOFT 1.15.1, device OpenAL Soft by OpenAL Community

TTTTTTTTTWSSSSSS

Warning: Skipped track section 6730 not in global or dynamic TSECTION.DAT

SSSSSSSWSSSSS TRP(default)WSSSSSSSSSSSSSSSSSSSSSSSSS$WSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS$

Warning: Cannot parse the constant number 83.5527-1023 in D:\Program Files (MSTS)\Microsoft Games\Train Simulator\ROUTES\Mersey\WORLD\w-006085+014932.ws:line 25

Warning: Cannot parse the constant number ) in D:\Program Files (MSTS)\Microsoft Games\Train Simulator\ROUTES\Mersey\WORLD\w-006085+014932.ws:line 25

WSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS$WSSSSSSSSSSSSS

Information: Skipped unknown texture addressing mode 9 first seen in shape d:\program files (msts)\microsoft games\train simulator\routes\mersey\shapes\uksemaphore2.s

SSSSSSSSSSSSSSS$WWWCS

Warning: 1 missing Stream(s) in D:\Program Files (MSTS)\Microsoft Games\Train Simulator\trains\trainset\UK_Electric_BR_Class82_E3046\sound\..\..\COMMON.SOUND\Class_81-85\class81Cab.sms:line 200

CSCCCCCSCSCCCCCSCSCSCCCCSCSSCCCCCSCSCS

Warning: Cannot parse the constant number ..\..\common.sound\EMU_Class310\x_motor1.wav in D:\Program Files (MSTS)\Microsoft Games\Train Simulator\trains\trainset\UK_Electric_BR_EMU_Cl310\sound\..\..\Common.Sound\EMU_Class310\Class310Cab.sms:line 22

Warning: Car with less than two axles/bogies (3 axles, 2 bogies) in D:\Program Files (MSTS)\Microsoft Games\Train Simulator\trains\trainset\UK_Electric_BR_EMU_Cl310\310emucar2.wag

CSCSCC

Warning: Car with less than two axles/bogies (3 axles, 2 bogies) in D:\Program Files (MSTS)\Microsoft Games\Train Simulator\trains\trainset\UK_Electric_BR_EMU_Cl310\310emucar2.wag

CCCCCCCC

Information: Ignored missing animations data in shape d:\program files (msts)\microsoft games\train simulator\routes\mersey\shapes\ukperspeed.s

Information: Ignored missing animations data in shape d:\program files (msts)\microsoft games\train simulator\routes\mersey\shapes\ukmilepost.s

Warning: Request to clear signal 2201 from train 102, signal already enabled for train 57

SSSSSSSSSSCC

Warning: Car with less than two axles/bogies (3 axles, 2 bogies) in D:\Program Files (MSTS)\Microsoft Games\Train Simulator\trains\trainset\UK_Electric_BR_EMU_Cl310\310emucar2.wag

CCCCCCSSSCC

Warning: Car with less than two axles/bogies (3 axles, 2 bogies) in D:\Program Files (MSTS)\Microsoft Games\Train Simulator\trains\trainset\UK_Electric_BR_EMU_Cl310\310emucar2.wag

CCSS

[dennisat]

Hi,

I've just posted my system specs and OR log for comparison but it's awaiting moderator approval.

Dennis

[dforrest]

I wondered if my problems are because of the sheer volume of data in the route, so I ran it through Train Store first to remove all the unwanted files for this activity - it made absolutely no difference!!

Train Store should not effect the opeartion as it has no real effect on OR running (see link below).

http://www.elvastower.com/forums/index. ... ntry127960

[slipperman12]

Hi David,
I fully appreciate that! It was just an experiment, because if the files aren't there, they won't be loaded by Open Rails.
Train Store WILL have an effect on the use of Open Rails in that hidden activities, paths, stock and consists will not be available to be run.

Cheers,
Ged

[slipperman12]

Hi Dennis,
Thanks for the listing of your log file.
Up to the point where mine crashed, there are a few differences :

Yours : Warning: Invalid crossover : indices 2021 and 2022 : equal section : 3694
Mine : Warning: Invalid crossover : indices 2021 and 2022 : equal section : 3692

Yours : SIGCFG DAT ACT RDB
Mine : ENV SIGCFG Followed by the line : Warning: Replaced duplicate TrackSection 360 in T:\MSTS\Train Simulator\GLOBAL\TSECTION.DAT:line 1455 followed by the line : ACT RDB

Mine : Crashed after the line : Information: Platform split by junction at McGregor Distribution Depot

I wonder if you're using a slightly different version of the route?
I am using v4.3 straight from the CD - NOT using the Steam "switch".

Cheers,
Ged

[dennisat]

...I am using v4.3 straight from the CD - NOT using the Steam "switch"...

I have V4.2 installed but I can't remember whether I installed it from the DVD or the downloaded files, I seem to have both. I am also using Tsection 38 which may have a bearing on the track messages.

I have now run all the way to Manchester with the act, arriving 4 minutes late. I was able to save and resume at any point on the route. The performance of the loco seems to be a bit less on OR than MSTS but they do have different physics models. I don't know if you've noticed at Elvas Tower but they are saying they are short of physics experts. They are suggesting that if someone has the knowledge and programming skills they should try their hands at it; it is Open Source after all.

Dennis

[slipperman12]

Hi Dennis,
Thanks.
I hadn't seen the comments on Elvas Tower, but similar things have been posted on trainsim.com; diesel locos run fine, but steam and electrics are, to put it kindly, not very good!

Unfortunately, my programming skills are not with any variety of C, so I wouldn't be of much use

Thanks for mentioning the tsection.dat file. I hadn't thought of that, so I've just checked mine - oops .. it's the original MSTS default version
That may well be my problem - I'll report back! Otherwise, I'll try installing the route from the download files and check the same activity.

Cheers,
Ged