Main Restorations Software Audio/Jukebox/MP3 Everything Else Buy/Sell/Trade
Project Announcements Monitor/Video GroovyMAME Merit/JVL Touchscreen Meet Up Retail Vendors
Driving & Racing Woodworking Software Support Forums Consoles Project Arcade Reviews
Automated Projects Artwork Frontend Support Forums Pinball Forum Discussion Old Boards
Raspberry Pi & Dev Board controls.dat Linux Miscellaneous Arcade Wiki Discussion Old Archives
Lightguns Arcade1Up Try the site in https mode Site News

Unread posts | New Replies | Recent posts | Rules | Chatroom | Wiki | File Repository | RSS | Submit news

  

Author Topic: Lightspeed MameLister© - A New Multi-List Generator (Now with link to download)  (Read 34547 times)

0 Members and 1 Guest are viewing this topic.

Antropus

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 61
  • Last login:March 14, 2017, 01:09:19 am
    • Antropus' Online Portfolio
Latest Version: Beta v0.7j
Updated on: 6/14/2016
Self-extract: https://drive.google.com/open?id=0B23vaxsfSk1yWjdXNlBoaTgwcUU
Zip: https://drive.google.com/open?id=0B23vaxsfSk1yaDB1MHFPQjVPVzA

Lightspeed Game List Generator


This program was developed as a token of appreciation towards the retro-gaming community.
Lightspeed is fast and it's free. It's my way of saying “thank you” to a community that helped me many times across almost two decades, directly or indirectly. Thank you and I hope you enjoy it.

Current Features
  • Easy to use Wizard interface
  • Top menu bar for quick access to any page of the Wizard
  • Supports Catver.ini, History.dat, Nplayers.ini, Languages.ini, Series.ini, Mame's output xml file and my own ControlsButtons.ini.
  • Built-in updater that will download all those support files and install them for you automatically, so it's a one step solution to get things updated every time a new version of Mame is released. [In Progress]
  • Over a hundred individual filters that can be used in combination to produce an incredible amount of possibilities, including filtering by genre, emulation status, decade, clones, control type, number of players, number of buttons, display type, orientation, region, media type, number of screens among others
  • You can choose to remove [] and () tags from game descriptions
  • You can choose to create CHD dummy roms for those CHD based games that do not have a companion rom, so front-ends can actually import and make those games playable
  • You can choose to create [TTL] dummy roms, so those games can also be imported and be playable from a front-end of your choice
  • The program will store all your settings on exit, as an ini file, so you don't have to check multiple boxes over and over again, every time you use the program. I'm planning to add “save presets”, where you will be able to save and load presets from.
  • No support files are ever merged. All support files are kept as-is and can be easily updated by simply copying newer files over them and any operations requiring access to those support files are handled at memory level, instead of writing files to disk. As a result, the performance is quite good: filtering a whole set of Mame ROMs from about 36,000 ROMs all the way down to a list of 2,600 games containing no Mature, pinball, fruit machines, devices, clones, Bios etc will take about 20 seconds from beginning to end, including saving the final resulting list and with no time spent on merging external files.
  • You can either generate “offline” lists, where the program doesn't care if you have roms in your system or you can tell Lightspeed to compare that information to your Mame ROMs folder, so the final list(s) will only contain games matching the .zip/.7z files that you actually have in your system
  • Ability to generate lists containing only the games that match your roms, snapshots, flyers and/or videos. This way you can make sure that you only import the games which you have snapshots for, for example. Or lists containing only games that you have videos for, videos+snaps, videos+flyers or any other combination of those. No more missing images/videos if you don't like having missing artwork showing up in your front-end.
  • A preset filter for “All Killer No Filler!”, a list of great games compiled by the user “BadMouth”.
  • Generate lists by platform using presets for: All Arcade Games, NeoGeo, CPS1, CPS2, CPS3, Cave, PGM, Zinc, Atomiswave, Naomi or Hikaru, individually or in combination
  • Generate lists by source driver. Everything supported by Mame is listed. You just need to know which one to pick. Just select a driver from the drop-down menu, “stv.cpp” for example, to generate a list containing only Sega STV games. All other filters affect this list as well.
  • Built-in snapshot preview, so you can verify visually the games being imported into your list
  • Built-in clone list-view, from where you can selectively add clones to your final output list using a context menu accessible on right-click
  • Built-in game launcher. Double click any game in either list-view to launch the game in Mame, a quick way to test games when in doubt if you should or not add them into your exported list
  • Built-in move/copy filtered ROMs and CHDs. That means that you can easily create a clean set that precisely matches your exported list, great for populating and synchronizing multiple machines while saving a ton of space since you are only adding the games that you really have, want or actually play
  • Support for multiple front-end's game list export formats. The current version supports:
  • Launchbox
  • Attract-Mode
  • Hyperspin
  • PinballX
  • Maximus Arcade*
  • Mala*
  • mGalaxy
  • MameWah (untested)
  • MameUI
  • AtomicFE
  • Cabrio
  • XML
  • Rom list
  • Description List
  • Missing List.
* Maximus Arcade and Mala require third-party programs to convert the lists generated by Lightspeed to their final format.

Exclusive for the Launchbox Frontend
  • Quickly and easily imports your filtered list of Mame games into Launchbox. This is a completely automated system that will add all necessary metadata and artwork, while setting up emulators, rom paths and platforms automatically. It will also adds a ton of filterable extra-fields, not originally supported by Launchbox. Run Lightspeed, set everything up, press export and re-open launchbox. It's that simple!
  • Imports metadata from History.dat selectively. You can choose what kind of information you want to parse: Bio, Technical, Trivia, Tips&Tricks, Staff, Ports, Scoring and/or Updates.
  • When it comes to the “export” versions of the games, History.dat only mentions that for more information you should refer to the original game, the Japanese version more than often. Lightspeed tries, as much as possible, to extract the information from the original game and recycle that information into the other sister games, so your metadata will actually look more complete since “export” games will now contain the metadata from the original game.
  • “Prevent Duplicates” prevents the same game from being imported multiple times.

I would like to thank:
  • The Mame team first and foremost. Without them none of this would be possible.
  • All support files creators and maintainers, especially Alexis Bousiges.
  • Every single one of you who create tools to make our lives easier daily
  • All involved with creating and cataloging arcade artwork and metadata
  • The whole community of generous individuals who had helped me directly or indirectly for almost two decades now
  • Jason Carr's Launchbox, an incredible piece of software and a great community
  • Those brave enough to try out my betas over the Launchbox's forums, helping me with initial bug tracking and suggestions to improve the program
  • RomLister for inspiring me in this "art of filtering" :)

This is a beta, so please test it and report if something is broken. Some features are still in progress, like custom XML file export, CSV and other formats, but I'm working on it.

Cheers,
-Kris

Antropus

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 61
  • Last login:March 14, 2017, 01:09:19 am
    • Antropus' Online Portfolio
Re: [PREVIEW] Lightspeed: A New Game List Generator
« Reply #1 on: May 24, 2016, 11:11:31 am »
Attract-mode list format export is now natively supported.
I'll keep adding support to as many front-ends as possible.
I also added an updater that downloads and unzips all necessary support files and can be used every time a new Mame version is released.

I should have a fully functional version for you guys to try in a week or so.

-Kris

8BitMonk

  • Trade Count: (+1)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 989
  • Last login:October 19, 2023, 05:27:00 pm
Re: Lightspeed: A New Game List Generator. Ideas?
« Reply #2 on: May 24, 2016, 02:33:04 pm »
Looking forward to the beta version, this type of utility is long overdue and would be greatly beneficial to the community. You should check out the Mawler thread if you haven't already, seems like a similar concept and many feature requests were discussed there.

http://forum.arcadecontrols.com/index.php/topic,136193.0.html

Good luck with development.
Games: Asteroids Deluxe | Atomiswave | Centipede | Championship Sprint | Defender | Donkey Kong | Dig Dug | Frogger | Ikari Warriors | Missile Command | Pac-Man | Pole Position | Robotron | Spy Hunter | Tempest | Super Mario Strikers

wp34

  • Trade Count: (+3)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 4794
  • Last login:April 10, 2022, 09:48:19 pm
Re: [PREVIEW] Lightspeed: A New Game List Generator
« Reply #3 on: May 24, 2016, 02:50:01 pm »
Attract-mode list format export is now natively supported.
I'll keep adding support to as many front-ends as possible.
I also added an updater that downloads and unzips all necessary support files and can be used every time a new Mame version is released.

I should have a fully functional version for you guys to try in a week or so.

-Kris

I was going to ask about Attract-Mode.  Thanks for doing this.  I'm anxious to try it out.


Antropus

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 61
  • Last login:March 14, 2017, 01:09:19 am
    • Antropus' Online Portfolio
Re: Lightspeed: A New Game List Generator. Ideas?
« Reply #4 on: May 24, 2016, 03:59:21 pm »
Thanks a lot guys!
That new Mawler project seem pretty awesome! Is he still developing it? Seems like that project is more of a full database though, including individual ROM info and all.

Mine is more focused on the list exporting side of things. The way I made it run quite faster than other alternatives was by stripping out any ROM CRC information from the mame XML file, among other things that are not useful for creating the lists. BUT, if that information becomes necessary at some point, like, if I decide to push this towards a full Mame database, then I might bring that information back.

I'm focusing on speed and accuracy more than anything else. I ran some benchmarks yesterday comparing matching filters between Lightspeed and RomLister, just for the sake of it.
When comparing filtering a large list (over 36000 games) against large list, Lightspeed was about 25% faster to create it. But when comparing lists generated for real-world applications, with no more than lets say 7000 games filtered, Lightspeed was over 160% faster. Also, some random entries were listed under a few lists generated with Romlister, which were not present in Lightspeed.

The cool thing about Lightspeed is that it shows the catver ini info very clearly in the listview, including genre and sub-genre. So if you decide to create a list of driving games only, for example, this should be the only type of genre listed and if an entry doesn't show that genre listed or shows a different genre listed, that means that the filter is not precise enough and needs tweaking, but at least it's a very quick diagnose. I'm testing all filters in complete isolation and also in random combinations and the results look correct as far as I can tell.

Since this is something I'm developing for the community much more than for myself at this point, please feel free to suggest things and please, if your front-end is not yet supported, the best thing you can do to help us all is to post a sample of the list format created by it. You can either post the file structure as a reply to this thread or attach it as a file so I can reproduce that structure and add your favorite front-end to it! :)

Thanks again,
-Kris

8BitMonk

  • Trade Count: (+1)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 989
  • Last login:October 19, 2023, 05:27:00 pm
Re: Lightspeed: A New Game List Generator. Ideas?
« Reply #5 on: May 25, 2016, 10:38:38 am »
IDS isn't actively developing Mawler anymore, he was going to add to it when his time free'd up a bit but that was probably a year ago. When the mame db structure changed a couple versions ago I ping'd him to see if he could update it but he was still too busy.

I think leaving out rom info is fine, one of the reasons it was included in Mawler was because it was an attempt at recreating the MAWS site where you had a pulldown menu to filter rom based on older versions of mame. Personally I was more interested in the list management features like you're going for.

For list management features, I had two requests:

1.) The ability to make custom meta-data and flag games with it.
2.) The ability to share that custom meta-data flagging with others.

The example I used for custom meta-data was creating a genre that wasn't covered by existing data like say a list of comic or super hero inspired titles (The Punisher and Marvel vs. Capcom) but it could be anything custom. My idea was for the user to be able to create a custom piece of meta-data, say a category named 'comics' and then manually selecting the titles that belong to it. Then in addition to being able to export those selections as a list to also be able to export them to share with others.

I personally use Hyperspin so that list format is primary on my list of FE's. The XML format for the lists is pretty straightforward.
« Last Edit: May 25, 2016, 10:51:49 am by 8BitMonk »
Games: Asteroids Deluxe | Atomiswave | Centipede | Championship Sprint | Defender | Donkey Kong | Dig Dug | Frogger | Ikari Warriors | Missile Command | Pac-Man | Pole Position | Robotron | Spy Hunter | Tempest | Super Mario Strikers

Antropus

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 61
  • Last login:March 14, 2017, 01:09:19 am
    • Antropus' Online Portfolio
Re: Lightspeed: A New Game List Generator. Ideas?
« Reply #6 on: May 25, 2016, 02:03:39 pm »
Thanks 8BitMonk!

Indeed. I thought about this feature as well when I was developing my previous software, which is more robust than this one and also a List Generator, although I shifted focus to this more newbie friendly approach so everyone can use it :)
I think the concept of having support files publicly maintained is the way to go or else things simply stop being developed. Look no further than the whole controls.xml changing hands for example.
Those things need to be community maintained, with some volunteers to check for inaccuracies and like you said, with the possibility of sharing your own lists.
I could definitely implement something in the sense of you being able to change things and save it to your own xml (or ini) file that could potentially be shared and re-imported by other users.

When it comes to a database though, there are things already being developed that have massive potential. The new Launchbox database for example is supposed to do just that. It's community maintained and moderated by a few volunteers who filter artworks which quality is not good enough. They are adding more and more metadata as well. In the near future people will be able to mass-edit games in Launchbox and update that info to their database, but this is still too specific for their front-end. If they open up for the general public, by creating an independent app to communicate to their database in a two-way mode for example, then the community as a whole would GREATLY benefit from it. I believe the free version of Launchbox will work with it as well, so maybe that's already covered.
Also, a huge feature that we should suggest them is the ability to export lists out of their database. That would be really cool as well.

Check out their database: http://gamesdb.launchbox-app.com/

-Kris     

nitrogen_widget

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 1746
  • Last login:Yesterday at 07:02:12 am
  • I want to build my own arcade controls!
Re: Lightspeed: A New Game List Generator. Ideas?
« Reply #7 on: May 25, 2016, 03:25:57 pm »
This looks nice.
I've been using RomLister and while i'm sure i'm to blame, it breaks often when it comes to merging all the metadata and generating a list from a search.  ;D

so something along the line's of mawler that is a little harder to break would be very nice.
Looking forward to testing.

NOP

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 916
  • Last login:September 19, 2017, 08:22:27 pm
  • I stole my avatar.
    • winterMAME
Re: Lightspeed: A New Game List Generator. Ideas?
« Reply #8 on: May 25, 2016, 11:34:36 pm »
I (as the author of ROMLister) welcome the new Lightspeed overlord.
It's been fun, but you're more enthusiastic than I am, so take the job and run with it!

Antropus

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 61
  • Last login:March 14, 2017, 01:09:19 am
    • Antropus' Online Portfolio
Re: Lightspeed: A New Game List Generator. Ideas?
« Reply #9 on: May 26, 2016, 05:21:03 pm »
I (as the author of ROMLister) welcome the new Lightspeed overlord.
It's been fun, but you're more enthusiastic than I am, so take the job and run with it!

I don't post much over here, but I hover over those forums for years now and one thing I can say is that I commend you, good sir, for being incredibly cool and helpful with everyone you interact with.
Your reply is a proof of that attitude. Now that I'm creating this I understand the incredible amount of work and research necessary to create some of those filters, even more so since we are supporting an ever changing environment, which is Mame and the non-stop structural changes when it comes to its xml. Not complaining about it, because those changes are necessary most of the time. Just stating the quick sand we try to stand on when developing tools to be used with Mame :)

About the enthusiasm, we both know that it comes and goes!
I would say that I'm very excited right now, so if people are looking for features, now would be the perfect time to ask! As a father of two with a full time job, free time comes and goes, but I will try to keep the steam going for as long as I can and I just can't wait to put a working version on your guys' hands.

Thanks again for all your work, inspiration and support over the years.
You rock, dude!

Cheers,
-Kris

DudeRegular

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 279
  • Last login:January 23, 2024, 10:50:27 pm
  • I have no idea what I am doing
Re: Lightspeed: A New Game List Generator. Ideas?
« Reply #10 on: May 26, 2016, 05:34:50 pm »
Looks like a great project man. I use Attract Mode too, so appreciate that format.

Slippyblade

  • Trade Count: (+2)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 3167
  • Last login:November 16, 2023, 11:39:51 am
  • And to the death god we say, "Not today!"
Re: Lightspeed: A New Game List Generator. Ideas?
« Reply #11 on: May 26, 2016, 06:28:57 pm »
As a ROMlister user, I'm glad NOP is cool with this.  It looks like a great project, good luck!

seinfeldfan64

  • Trade Count: (0)
  • Jr. Member
  • **
  • Offline Offline
  • Posts: 4
  • Last login:November 10, 2019, 09:41:38 pm
Re: Lightspeed: A New Game List Generator. Ideas?
« Reply #12 on: May 26, 2016, 10:54:45 pm »
I wish I had something to contribute besides a big thank you! I've used Lightspeed to import into Launchbox and found it very powerful and easy to use. I'm looking forward to trying it out with Attact-Mode and Hyperspin.

Antropus

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 61
  • Last login:March 14, 2017, 01:09:19 am
    • Antropus' Online Portfolio
Re: Lightspeed: A New Game List Generator. Ideas?
« Reply #13 on: May 27, 2016, 01:29:25 pm »
Thank you so much for the support, guys!

It doesn't seem like much, but A LOT is being done under the hood and I got things more optimized and modular now. Still work to do, but getting easier to update things. Some more features:

- Here are the new options I mentioned. If you check all of those last 4 options, the exported list will only contain games that have artwork available for them. I just exported a list and BigBox looked great, with absolutely no missing artwork :)


The All Killer No Filler filter just got fancier:
1) Firstly, it basically overrides the other filters, so only the games in this list will be imported when you check this box.
2) BUT, you now have the option to choose if the other filters will have influence over this list. If you choose to bypass the filters, then the full list will be generated, including BIOS and all. If you don't choose to bypass the filters, then everything is taken in account, so you can get rid of all BIOS in that list, so the list will contain only the games themselves. Or you can eliminate the CHDs from the list. You can generate an all vertical All Killer shmups for example or any other filters that will be applied to the All Killer list.
3) On the favorites idea, now you can choose to make the games in the All Killer list as favorites, as long as your front-end supports it through the game list. So far it only works for LaunchBox/BigBox, but let me know which other FEs save that in their lists and I can easily implement it. Just mark that checkbox and all games in the list will be favorite'd when the list is exported. If you use Launchbox, another way to do this is to rename the Mame Arcade platform to "All Killer", for example, export those games as part of this platform and in Launchbox you can mass edit all games in it as favorites and then mass edit them again, moving them into your Mame Arcade platform this time:


I started adding a context menu that will grow quite a bit. So far it's pretty basic, but you can already select all, invert selection, delete selected and move selected clones into the output list. I will be adding more stuff soon:


Sorry it's taking a little long to get a new version out. I really need to iron things out some more and there are many ideas lingering around my head now. I had this crazy idea of creating a "GameList Blender". It would work like this:
- Select a list format from the dropdown menu, hyperspin for example, then click import to have your old list imported into Lightspeed. If the information is incomplete, it doesn't really matter right now. This list will be parsed into a "Blender" listview. Now select another format, attract-mode for example, and import your attract-mode list. It will be merged with the previous list and anything already there will be skipped. You will be able to merge as many lists from as many different front-ends as you wish, so you can basically consolidate all lists from all the different FEs you might use into a single list if you wish. But here comes the great part about it: this list will become a filter and all the metadata will be parsed again and anything missing before will now be filled in for you, as long as the exporting format supports all those fields. Now you can simply export this consolidated list to all your front-ends again, super-fast. A little ambitious, but I think I can make it work.

This will turn Lightspeed into an all around importer and exporter for gamelists and can be very useful at times, in my own experience.

Cheers,
-Kris

Antropus

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 61
  • Last login:March 14, 2017, 01:09:19 am
    • Antropus' Online Portfolio
Re: Lightspeed: A New Game List Generator. Ideas?
« Reply #14 on: May 27, 2016, 01:42:18 pm »
I forgot to mention that Lightspeed is being tested with Win7 and Windows 10 only, so I could not say that it will work with windows XP, unless someone tests it.

-Kris

Antropus

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 61
  • Last login:March 14, 2017, 01:09:19 am
    • Antropus' Online Portfolio
Re: Lightspeed: A New Game List Generator. Ideas?
« Reply #15 on: May 29, 2016, 10:07:29 pm »
Weekend update:

1) I changed my code to be faster and more effective when cross-referencing folder contents. As a consequence, you can now also choose to match your final list with the Wheels/Clearlogos that you have.
2) I incorporated the update buttons as a very easy, straight forward way of getting the latest support files available, so Lightspeed can be always up-to-date. The way it works: downloads the files > unzips them into a temp folder > copies the necessary file to the correct folder > deletes the temp folder > reads the uncompressed file to capture its version from the header > updated the interface to reflect that number by the update button side, so you know which versions you are using at all times.


3) AntoPISA did a great thing with his Catver.ini, Series.ini and Languages.ini. He kept the download names consistent every time there's a new version for download, so the updater simply works. Now, with History.dat and NPlayers.ini, the names change every time there's a new version and it's not only an update on the number itself, like "0174", but sometimes "0174a", for example. For that reason I added an inputbox that you can use to enter the new version that you are looking for, with examples you can try. Again, this is only necessary for NPlayers.ini and History.dat


4) History.dat is the only support file that's big. For that reason I added a little progress bar:


5) Because I understand the importance of the work being done by the support files creators/maintainers, after any of those updates you will get a popup window crediting the authors and providing a link that everybody is encouraged to click to support their projects (as I understand, they need traffic and accept donations, so please click the links!).


5b) Same here:


You can now generate/update your Mame xml file via the mame -listxml command line running under the hood:


-Kris

Antropus

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 61
  • Last login:March 14, 2017, 01:09:19 am
    • Antropus' Online Portfolio
First post updated. You can now download and test the first *official* version:

Download:
Self-extract: https://drive.google.com/open?id=0B23vaxsfSk1ydFFuclZncld0bmM
7z: https://drive.google.com/open?id=0B23vaxsfSk1yTVo3YVNPc2NSRm8

Please download, install, try it out and report anything broken. A 20+ pages manual comes with it, so make sure you take a look.

Cheers!
-Kris

gonzo90017

  • Trade Count: (+5)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 1034
  • Last login:June 23, 2019, 02:41:07 pm
  • I'm a llama!
A small feature request. I would like to see an option to "Move" roms. This way I can have a folder that contains only the roms that are generated from the lists that are created. I know Hard Drives are cheap these days. But i'm using some spare PCs that don't have much hard drive space.

Antropus

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 61
  • Last login:March 14, 2017, 01:09:19 am
    • Antropus' Online Portfolio
A small feature request. I would like to see an option to "Move" roms. This way I can have a folder that contains only the roms that are generated from the lists that are created. I know Hard Drives are cheap these days. But i'm using some spare PCs that don't have much hard drive space.
This feature is already present :)

Check the bottom left corner:


gonzo90017

  • Trade Count: (+5)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 1034
  • Last login:June 23, 2019, 02:41:07 pm
  • I'm a llama!

Antropus

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 61
  • Last login:March 14, 2017, 01:09:19 am
    • Antropus' Online Portfolio
New version coming up tomorrow with some important bug fixes, much improved controllers support and a much better parser for history.dat notes.
As it stands, a lot of games in history.dat are presented as "Export version". When that happens, history.dat normally refers to the original game, usually the Japanese version if you want to read the actual notes, since those are only kept within the original version. Lightspeed does some stuff under the hood to make sure that the most complete notes are always parsed. As a consequence, the notes parsed by Lightspeed are usually more complete than if you are simply parsing straight from history.dat.

Here's a comparison between the data being directly parsed by MAME and my approach, which is better suited for front-ends that support notes, like LaunchBox:

 

Antropus

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 61
  • Last login:March 14, 2017, 01:09:19 am
    • Antropus' Online Portfolio
Latest Version: Beta v0.7h
Updated on: 6/9/2016
Self-extract: https://drive.google.com/open?id=0B23vaxsfSk1ydzhZb0NSOHNHMGM
Zip: https://drive.google.com/open?id=0B23vaxsfSk1yNHZ4VzFXN2tBTkk

  • Introducing History ReparserTM, a much better way to extract notes from History.dat. Games marked as “Export version” will now have a much better chance to have their notes extracted from the original games, so, much more complete notes from now on if you use LaunchBox.
  • Updated all support files to the latest versions available.
  • Improved controllers metadata. Most games now have a controller associated to them.
  • Renamed the default platform from “Mame Arcade” to simply “Arcade”
  • TTL and CHD “dummy” files generated are now true .zip files instead of text files named .zip.
  • Improved auto-fill when selecting MAME.exe
  • Improved “reset” functions.
  • FiltersA, 3rd toggle now ignores “All Killer” filter, since this is a very specific filter that ends up overwriting all others
    Removed the game descriptions in the status bar when parsing lists. This sped up the process by a few seconds. The progress bar is still present.
  • Removed some splash screens. All info related should now be presented at the status bar, which is way faster than splash screens (it's all about speed after all).
  • Improved attract-mode generated lists.

Enjoy and please report anything funky. Thanks.
-Kris

Milky

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 98
  • Last login:February 22, 2022, 07:57:34 pm
  • I want to build my own arcade controls!
This program is amazing, great job!  I do have 2 questions and it's probably due to my incompetence, but The Simpsons doesn't seem to come up on the list for me no matter what filters I apply.  I was trying to make a list of 2/3/4 player games, but it wouldn't show up on any of the lists that were generated.  I wasn't sure if it was a bug or something I was doing.

Next, I've been trying to sort using the All Killer filter, but no matter what I try the list never generates as it never finds any games.  Is there a file I need to have the program point to or something else I need to do that I'm not catching? 

Like I said though, amazing program and great work!

Antropus

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 61
  • Last login:March 14, 2017, 01:09:19 am
    • Antropus' Online Portfolio
Thank you for trying it out and for reporting, Milky!
The problem is on my side. I changed some filters recently and seem like, for some reason, The Simpsons is falling into the "unknown" category when it comes to number of players, although NPlayers.ini has the information correctly. I will investigate and get that fixed tonight, so no worries!

As for the All Killer list, it's working on my side. Make sure you have a folder called:
.\SupportFiles\All Killer Lists\

You should have a bunch of files in there, separated by genre. To make sure you got the necessary filters on, go to every tab and click "reset", and then check the All Killer checkbox and try to generate your list again.
Let me know if it still doesn't work. If does not work, please post some screenshots of the filters you are using so I can try to emulate your settings on my side.

Thanks a lot!
-Kris

Antropus

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 61
  • Last login:March 14, 2017, 01:09:19 am
    • Antropus' Online Portfolio
Latest Version: Beta v0.7i
Updated on: 6/10/2016
Self-extract: https://drive.google.com/open?id=0B23vaxsfSk1yaV9sZU1CMWFldFk
Zip: https://drive.google.com/open?id=0B23vaxsfSk1yNlNXT0lhRHVtRUk

  • Fixed a bug that was causing the number of players to be parsed incorrectly (thanks Milky!).

-Kris

Milky

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 98
  • Last login:February 22, 2022, 07:57:34 pm
  • I want to build my own arcade controls!
Looks like it's catching the game properly.  Also, I must have been missing the support files for the All Killer lists as they seem to be working now!

Antropus

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 61
  • Last login:March 14, 2017, 01:09:19 am
    • Antropus' Online Portfolio
Glad to know :)
Let me know if anything else doesn't look good!

-Kris

Milky

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 98
  • Last login:February 22, 2022, 07:57:34 pm
  • I want to build my own arcade controls!
I've been toying around with this some more and I was wondering about something.  Is it possible to import a particular XML so that you can constantly edit it without having to recreate a list from scratch?  What I would like to be able to do is generate a list, pull it up in HS, see what games I don't like/don't work, and remove them as I find them.  If it's possible to import an XML file for editing I would be able to constantly pull up the same file and just remove the new games I come across instead generating a full list and having to delete all of the old game all over again. 

I'm not sure if that makes sense or if it's even possible, but I figured I'd check!

DudeRegular

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 279
  • Last login:January 23, 2024, 10:50:27 pm
  • I have no idea what I am doing
Wanted to post some feedback, but understand I may have just not done something correctly causing some of this to be moot. Really liking the program so far. Great work.

1. Love the fact that you can launch a rom right from the final page. Great feature.

2. Would like to be able to highlight just certain games, then hit export to only have the selected in a list.

3. Using the killer lists, it adds it all into one big list at the end. Can you add a column to see which list a title is from? then see point 2.

4. Emulators/platform tab: add supermodel, like the option to go from driver, but that is a big ol list in there, and may be a bit much for most.

5. copy/move is another really great feature.

6. Clones tab: possible to describe some of the clones/hacks in better detail? Not sure if that is present in one of the ini/dat files being referenced or not.

7. resize/maximize the window: seems to be locked to the one size now.

8. in the last tab, i noticed when resizing columns that there are a bunch of columns that appeared from their hiding spots all over. Maybe a right click option there to view/hide columns to this view?

9. "&" Ampersand characters are showing in titles as "&amp"



I've been toying around with this some more and I was wondering about something.  Is it possible to import a particular XML so that you can constantly edit it without having to recreate a list from scratch?  What I would like to be able to do is generate a list, pull it up in HS, see what games I don't like/don't work, and remove them as I find them.  If it's possible to import an XML file for editing I would be able to constantly pull up the same file and just remove the new games I come across instead generating a full list and having to delete all of the old game all over again. 

I'm not sure if that makes sense or if it's even possible, but I figured I'd check!

Good idea. Would make updating a machine easier. I personally would use this in conjunction with my 2 and 3 points above. Say I want to update my fighter list with some new game. Just load it into the app and filter based on the latest roms, add, done.
« Last Edit: June 19, 2016, 12:45:08 am by DudeRegular »

DonkyKong

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 23
  • Last login:December 15, 2016, 08:35:34 pm
Antropus Loving your work :applaud: :applaud: :applaud:

Not sure if this a known bug or not?

After 3 years I tried to update my Bartop cabinet with latest MAME the Bartop runs MalaFE while I found out that MalaFE doesn't support the new MAME XML since the merger of MESS, So I tried your great program it filters fine (8762) games, But when I hit the GO! button for the MalaFE output gamelist file it only gets 1/4 through and ends with a total of (1903) games ??? ??? ??? ??? :banghead: :lol :lol
« Last Edit: June 19, 2016, 03:24:58 am by DonkyKong »

DonkyKong

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 23
  • Last login:December 15, 2016, 08:35:34 pm
« Last Edit: June 19, 2016, 03:22:54 am by DonkyKong »

Antropus

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 61
  • Last login:March 14, 2017, 01:09:19 am
    • Antropus' Online Portfolio
Thank you so much for the feedback guys!

Based on those feature requests and some other requests I'm gathering from other forums, I think the current format is kinda exhausted, unfortunately. I thought I could keep it simple enough, but we need more features. There are things that I wish I could add here, but the format is not helping. The program was started as a fast way to help Launchbox users to import their collections and because of that it carries a lot of unnecessary legacy code at this point and it's just not as flexible as it needs to be.

For this reason I decided to stop the updates on this format for now and concentrate on merging this program with my previously unreleased one, that in fact carries a lot of the features people mentioned.
For example:
- You can import lists
- You can merge lists
- You can audit many artwork folders
- You have visual feedback for artwork and game status
- It has a built-in rating system.
- It has a more robust, faster way to filter lists
- Built-in, ultra fast search
- Easily merge results from any list into your final list
- Resizable GUI

This transition will take me some time, but I think it's worthy on the long run, because at the end you will get the best solution available, which will still combine the Wizard mentality with a very robust list manager.

For now you can use the latest, which has some bug fixes and if you are patient you will be able to test a very different beast next time:
Latest Version: Beta v0.7j
Updated on: 6/14/2016
Self-extract: https://drive.google.com/open?id=0B23vaxsfSk1yWjdXNlBoaTgwcUU
Zip: https://drive.google.com/open?id=0B23vaxsfSk1yaDB1MHFPQjVPVzA

Attached are some snaps of my older program. The plan is to merge those features into Lightspeed.

Cheers,
-Kris

Milky

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 98
  • Last login:February 22, 2022, 07:57:34 pm
  • I want to build my own arcade controls!
Just wanted to say you're doing amazing work and the current program is still amazing in terms of ease of use and power!  Great job!

gonzo90017

  • Trade Count: (+5)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 1034
  • Last login:June 23, 2019, 02:41:07 pm
  • I'm a llama!
Thank you for hanging in there!

Antropus

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 61
  • Last login:March 14, 2017, 01:09:19 am
    • Antropus' Online Portfolio
Thank you so much for your support and kind words, guys. Much appreciated.

I'm slowly but surely making progress on integrating my two programs into an all-in-one solution, while implementing new features and fixing bugs. Some of the new implementations:

- To optimize memory and speed, I decided to generate my own database master file. It will come packaged with Lightspeed, so you don't need to worry about creating it, but every time a new version of MAME is released, you will need to generate a new listxml file anyway, so in that process, a new database file will be created as well. It takes about 20-30 seconds or so. Once it's created, then starting Lightspeed shouldn't take longer than 6-7 seconds.
- Huge speed improvements thanks to the method above. Granted that not all filters are hooked just yet (need to re-write them all...), at this point to produce a fully filtered list of about 7000 games it's taking about 4 seconds, which is more than double the speed of previous methods!
- GUI is now fully resizable, going to as low as 800x600 and as high as your monitor allow.
- "&" Ampersand characters now showing correctly
- There are now 5 different listviews: Full List, Parents, Clones, Search and Output. The first 3 never change and are there as data sources only. You will be able to select any number of rows and sent those games to the output list with a single click. The search listview will contain the results of your searches, initially by: terms in any of the columns, in the description, in rom name, in year, in manufacturer. As with the other lists, you can select any number of games and send those to the output list as you wish. The output list is what you will get when exporting. You can remove games from it or send games from other lists into it at any given time.
- You can launch games from any list. Simply double-click a game and it will launch through MAME, no matter which list you are at.
- Added all other MAME artwork folders. All those folders are being parsed on startup every time you open Lightspeed, so it will list all the artwork you have and everything missing as well, which can be later on exported as missing/have lists. It's a fast process and it's already included in the 6-7 seconds that takes for the whole program to load.
- Added the arcade machine artwork, which supports snap and marquee preview

Things are quite temporary in those screenshots, but at least you have an idea about the progress (see attachments).

More to come and still a LOT left, but I will get there.

Cheers,
-Kris

DudeRegular

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 279
  • Last login:January 23, 2024, 10:50:27 pm
  • I have no idea what I am doing
Kickass man. Keep at it.

DonkyKong

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 23
  • Last login:December 15, 2016, 08:35:34 pm
WOW! looking good.

chill

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 11
  • Last login:July 05, 2019, 01:33:19 pm
 :applaud:
"Ability to generate lists containing only the games that match your roms, snapshots, flyers and/or videos. This way you can make sure that you only import the games which you have snapshots for, for example. Or lists containing only games that you have videos for, videos+snaps, videos+flyers or any other combination of those. No more missing images/videos if you don't like having missing artwork showing up in your front-end."

Excellent utility. I just finished my retropie/Attract Mode build and this was an excellent way to clean my lists that were missing artwork.

Sorn

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 52
  • Last login:July 09, 2018, 08:56:19 pm
  • I want to build my own arcade controls!
Ahhhh, where were you 6 months ago haha!! I was dying for this utility!!! I ended up spending many many hours hand editing. Thanks for this, it will come in great use eventually and it looks SHARP!

floob

  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 36
  • Last login:January 11, 2023, 04:36:51 pm
  • Looking to buy a pre-made MAME cab.
    • Retrogaming on a Raspberry Pi
Can the tool be independent of MAME? When I try to run it I get a message saying the MAME path cant be blank.
I'll read through your manual in case its in there.

I'd like it in a similar way to Romlister where I can input an xml/dat file and filter based on that alone?