Space Engineers

Space Engineers

Not enough ratings
Official: Testing Tool Guide (Update 01.134)
By Drui
Testing Tool is a simple application for recording and playing a saved game. It was created to help us test scenarios and to understand how things work in the game, but can also be used by anyone who has a Keen Software House game to run and play back your games, and to give us your feedback!
 
Rate  
Favorite
Favorited
Unfavorite
Requirements & How to use
Requirements:
  • Steam account
  • Any of our current games installed through Steam
  • At least one saved game for the specific game
  • Hardware requirements for the specific game
How to use:
  1. Go to the Steam directory of your Keen Software House game and find TestingTool under the tool directory
  2. Run TestingTool.exe using the most updated version of our games
  3. Check if the settings for a game are correct
  4. Press the Settings button
  5. Choose an executable filename (e.g. SpaceEngineers)
  6. Choose the Steam executable directory (e.g. C:\Program Files (x86)\Steam\steamapps\common\SpaceEngineers\Bin64)
  7. Press OK

If all went well, you have set the tool up successfully! If you get warning message, check to make sure you provided the correct directory and executable filename.

Now let’s record a TestCase!
  1. Press the “add test case” button
  2. In the menu that appears, select a saved game
  3. Provide a name for that case (e.g. Build Small Ship Case)
  4. Press “Start Recording”
  5. The Game will load the saved game you have chosen
  6. Do something in the world that you want to be recorded
  7. Exit to the Main Menu
  8. Press “Exit Game”
  9. When asked if you want to save the game, press “No” (altering the save will ruin the test case)
  10. The game will exit and the TestingTool will unblock
  11. On the main window, you will see a new case that has been recorded with the specified name

Again, if nothing crashed, you will now have a recorded Test Case. Now it is time to play back that case:
  1. Check the case(s) you want and press the “Run Checked” button
  2. Sit, relax and watch your Test Case play back
  3. The game will exit
  4. There should be comparison results available, telling you if the cases are the same or not
  5. Clicking on the result will show more info about each case

The results of a Test Case will be one of the following:
  • TEST_SUCCESSFUL: If this shows up, we are happy people :-)
  • TEST_CRASHED: There is a problem – please check the log report on forums
  • IMAGES_DIFFER: A basic check occurred that found images that are completely different. If there are random scenarios, they will provide this result frequently.
  • SAVES_DIFFER: Checks if the data is approximately the same after exiting a case. Random data (or an aggregate of it) can trigger false alarms and should be ignored
  • ASSERTION_DETECTED: An assertion happened that should be written in the game log

Other notes:
- The TestCases folder is located (or should be automatically created) in the same folder as the Saves directory
- For random scenarios and variables, the playback case of the tool will differ from the recorded case of the tool
- Make sure the AppVersion of your save file is valid prior to recording a case and you have optimized settings for the game on your graphics card application

Some Example runs of failed cases during development:
< >
3 Comments
Xariman May 12, 2016 @ 6:49pm 
nice
Doctor Octoganapus May 12, 2016 @ 5:09pm 
@Sinner_D Its in your game directory - SteamApps\common\SpaceEngineers\Tools\TestingTool
Sinner_D May 12, 2016 @ 4:56pm 
I have both Medival engineers and space engineers, why do I not have access to this tool? Zero things show up in the tools section regarding space engineers