Main Restorations Software Audio/Jukebox/MP3 Everything Else Buy/Sell/Trade
Project Announcements Monitor/Video GroovyMAME Merit/JVL Touchscreen Meet Up Retail Vendors
Driving & Racing Woodworking Software Support Forums Consoles Project Arcade Reviews
Automated Projects Artwork Frontend Support Forums Pinball Forum Discussion Old Boards
Raspberry Pi & Dev Board controls.dat Linux Miscellaneous Arcade Wiki Discussion Old Archives
Lightguns Arcade1Up Try the site in https mode Site News

Unread posts | New Replies | Recent posts | Rules | Chatroom | Wiki | File Repository | RSS | Submit news

  

Author Topic: MAME Benchmarking site updated (FINALLY!)  (Read 1679 times)

0 Members and 1 Guest are viewing this topic.

elvis

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 1154
  • Last login:January 13, 2025, 08:48:40 am
  • penguin poker
    • StickFreaks
MAME Benchmarking site updated (FINALLY!)
« on: August 17, 2006, 02:50:23 am »
I pulled my finger out and finally got my MAME benchmarking site update.

http://benchmark.mameworld.net/

[edit] MAMEWorld is down, use the direct link here:
http://www.gamedude.com.au/arcade/benchmark/

It's now database driven, and accepts public entries.  Feel free to benchmark your own system(s) and upload the data for others to see. 

The aim is as always - a resource for folks to use if they ever have troubles choosing what hardware they want to run MAME on.

Don't feel the need to benchmark bleeding edge hardware/software only.  Benchmarks from old builds on old hardware are just as useful.  People don't always buy new hardware for MAME - sometimes they use old leftover stuff and want to get an idea of how it will run.

I knocked this up in a bit of a rush, so if something's broken, please let me know and I'll fix it ASAP.  Also if you're benchmarking on obscure hardware that's not listed on the site, let me know and I'll add it to the database.

Happy benching!
« Last Edit: August 19, 2006, 08:22:40 pm by elvis »

brophog

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 486
  • Last login:January 20, 2019, 03:49:41 am
  • I want to build my own arcade controls!
Re: MAME Benchmarking site updated (FINALLY!)
« Reply #1 on: August 17, 2006, 03:25:42 am »
Actually, older hardware is probably more helpful for a few reasons.

One, people use it more, as elvis said. But second, almost everything runs on older hardware with very few exceptions. Think of your favorite games and almost none of them require newer hardware to run........on any version of mame.

Silver

  • Wiki Contributor
  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 1668
  • Last login:April 16, 2025, 04:09:53 pm
  • Cunning like the Fox.
    • Mods'n'Mods
Re: MAME Benchmarking site updated (FINALLY!)
« Reply #2 on: August 17, 2006, 10:49:42 am »
Hey, you could add RB's results on his new Conroe (Core 2 Duo).... probably the fastest way in the world to play mame right now....

http://rbelmont.mameworld.info/

elvis

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 1154
  • Last login:January 13, 2025, 08:48:40 am
  • penguin poker
    • StickFreaks
Re: MAME Benchmarking site updated (FINALLY!)
« Reply #3 on: August 17, 2006, 06:05:52 pm »
Hey, you could add RB's results on his new Conroe (Core 2 Duo).... probably the fastest way in the world to play mame right now....

http://rbelmont.mameworld.info/
I'll email hit today and get permission.  As soon as that's confirmed I'll add them.

[edit] I notice he uses the -nosound option.  That affects the benchmarks (for some games it can more than double the end result, depending on audio hardware).

I'll try and get a hold of a Conroe core and repeat the tests myself.
« Last Edit: August 17, 2006, 06:10:05 pm by elvis »

MiKman

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 360
  • Last login:March 25, 2018, 12:28:45 pm
  • Blah
Re: MAME Benchmarking site updated (FINALLY!)
« Reply #4 on: August 18, 2006, 12:56:39 pm »
Is the benchmarking site currently down?  all I get is the following:

ERROR
The requested URL could not be retrieved

--------------------------------------------------------------------------------

While trying to retrieve the URL: http://benchmark.mameworld.net/

The following error was encountered:

Connection Failed
The system returned:

    (110) Connection timed outThe remote host or network may be down. Please try the request again.

Your cache administrator is root.



--------------------------------------------------------------------------------

Generated Fri, 18 Aug 2006 17:53:20 GMT by zipcache.ztnet.com (squid/2.5.STABLE10)

horseboy

  • Only Saint has those powers.
  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 1562
  • Last login:March 07, 2021, 02:19:14 pm
  • With my last breath, I curse Zoidberg!
Re: MAME Benchmarking site updated (FINALLY!)
« Reply #5 on: August 18, 2006, 01:24:25 pm »
All mameworld sites are down at the moment. I have no idea why, though?


Quote from: saint
saint is all powerful.

Apparently he is.

AaronGiles

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 26
  • Last login:May 17, 2008, 09:59:11 pm
  • I want to build my own arcade controls!
    • Aaron's Home Page
Re: MAME Benchmarking site updated (FINALLY!)
« Reply #6 on: August 18, 2006, 02:11:39 pm »
[edit] I notice he uses the -nosound option.  That affects the benchmarks (for some games it can more than double the end result, depending on audio hardware).

I'll try and get a hold of a Conroe core and repeat the tests myself.

That's the least of your troubles. -nosound has very little effect on speed anymore. Plus, the options are significantly different now, so your old command line is useless as well. You'll need to update your methodology before you can hope to get any kind of consistent results with modern builds.

Howard_Casto

  • Idiot Police
  • Trade Count: (+1)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 19428
  • Last login:Yesterday at 06:13:49 pm
  • Your Post's Soul is MINE!!! .......Again??
    • The Dragon King
Re: MAME Benchmarking site updated (FINALLY!)
« Reply #7 on: August 18, 2006, 04:15:30 pm »
Agreed...

Regardless this is a futile effort anyway.  The only way to have a truely useful database is to have someone (or a team of someones) try every single game on every single version of mame toggling on/off every single speed effecting option, with a wide range of computers with different specs and processors. 

I can tell you from experience on controls.dat you might get 10 people to help you on a regular basis and the fact that your project actually requires different pcs to test makes it an even harder thing to tackle. 

In the words of sir bender:  "Thou art royally boned."

elvis

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 1154
  • Last login:January 13, 2025, 08:48:40 am
  • penguin poker
    • StickFreaks
Re: MAME Benchmarking site updated (FINALLY!)
« Reply #8 on: August 18, 2006, 06:43:41 pm »
Plus, the options are significantly different now, so your old command line is useless as well. You'll need to update your methodology before you can hope to get any kind of consistent results with modern builds.
Yeah, I know.  I slapped a quick disclaimer up on the "howto" page saying it's out of date.

If I get time this weekend I'll throw some commands up for benchmarking MAME under various operating systems for various builds.  Obviously if old and new builds are going to be in the database, there needs to be a guide for each of the major core changes, with 0.107 being a good example of such a thing.

Regardless this is a futile effort anyway.

I can tell you from experience on controls.dat you might get 10 people to help you on a regular basis and the fact that your project actually requires different pcs to test makes it an even harder thing to tackle. 
All good there.  There's quite a number of folks who have submitted benchmarks in the past manually.  I was quite surprised at the feedback actually.  I've been in contact with some of them again and they are keen to take up the cause and keep contributing.

Recently I also made a self-running CDROM that benchmarks various games.  I handed it out to a number of geek mates, and they emailed me the results.  When I get time, I'll add that data too.

The beauty is that the contributors don't need a great deal of technical knowledge.  As soon as I get the howto part fixed, it's a matter of copy, paste, submit.

Once there's enough data in the database I'm going add a few other searches to play with the results.  As they say, there are lies, damned lies, and then there are statistics.  But I think it will be fun to see what interpolation of the data will try to "predict" about future MAME builds and future hardware.  Always good for a laugh. :)

All mameworld sites are down at the moment. I have no idea why, though?
Yeah it looks like the whole of mame/mameworld sits behind the same reverse proxy or something.  Everything seems busted at the moment. 

If you want to get to just the database itself, it's hosted on a different server:
http://www.gamedude.com.au/arcade/benchmark/

Despite numerous emails the MW kids never got back to me about database access (part of the reason it took so long to change the site).  So instead I slapped it up elsewhere for the meantime.
« Last Edit: August 18, 2006, 06:59:13 pm by elvis »