Introducing Intel Monkey (Another New Version: 0.4.1b) (Full Version)

All Forums >> [New Releases from Matrix Games] >> War in the Pacific: Admiral's Edition



Message


witpqs -> Introducing Intel Monkey (Another New Version: 0.4.1b) (9/3/2012 9:50:00 PM)

Introducing Intel Monkey

Intel Monkey is a program for WITP-AE players to help facilitate digesting Intel provided in the various reports (SigInt, Combat, Operations, Events). Here is the link to the .zip file in Google Docs.



(Link in Signature below.)

Intel Monkey is written in Python, beginning with Python version 3.2.3 and requires that version of Python or higher be installed in order to run Intel Monkey. It is technically independent of the Windows operating system, but as AE is a windows only program I doubt that Intel Monkey will be used on either Linux or Mac OS.

The program reads in the player's report files that AE archives every turn. Those files are located in "save/archive" (in AE's main folder find folder "save", inside that folder find folder "archive").

Your AE shortcut must have the "-archive" switch for AE to create those files every turn.

Current State and Use Instructions

The program reads files from AE's "save/archive" folder. Make certain you play AE with the "-archive" switch or else those files will not be created and there will be nothing to read.

Intel Monkey is still very new and has a very small set of functions compared to what is intended. Currently Intel Monkey processes all of the player's SigInt files. Future versions will process with other files as well.

- When started, Intel Monkey will take several seconds to read in all the SigInt files.

- A GUI window will open, where the information is displayed.

- Each line from each SigInt file has been made into its own record with the date at the front, and parsed into fields containing the various information. Note that some of the line come with four pieces of information (including the date) while others come with six (including the date).

- Buttons in the lower left corner allow the report to be sorted according to the criteria noted next to each button.

- You can click in the "Enter Search Text" box and type in something to search for. The first occurrence from the top (in the currently selected sort order) will be found and positioned in approximately the middle of the screen. The search is case insensitive (upper/lower case does not matter).

- The report can be scrolled using the scroll bars, or just click inside it to use the keyboard (PageUp, PageDown, etc.) or the mouse wheel if your mouse has one.

- You can select text in the report and copy it a) to some other program or text editor (useful if you are making notes for yourself), or b) into the search text entry area (useful to search for something you see now that causes you to want to change the sort order and look at all similar things).

- When finished, click on the X in the upper right-hand corner to close Intel Monkey.

There are many additional functions planned for Intel Monkey, including reading in and processing the other reports. The present functions are very useful already as they allow a player to see SigInt reports for a specific base, or all reports for a specific enemy unit, and so on.


Screen Pic Sample
Below you see a capture of my screen when running Intel Monkey, and I overlapped a few things for you to see them clearly. In the upper right is my AE shortcuts folder. There you see my shortcut for running AE, my shortcut for running Tracker, and my shortcut for running Intel Monkey. In the upper left you see a window that opens when Intel Monkey runs, which is similar to the window that opens when Tracker runs. You never have to do anything with that window. The large GUI window below is the main Intel monkey window. There you see the report displayed, the buttons on the lower left for you to choose how to sort the report, and the search box to the right of those buttons.

[image]local://upfiles/14248/99A3338079434E1C97022FB69046FB75.jpg[/image]

NOTE: Now working for multi-day turns.

Another new version:
The link is to a new version, V0.2.2e




Andav -> RE: Introducing Intel Monkey (9/3/2012 10:01:10 PM)


I like to think my dazzling play and elaborate attempts at deception have forced witpqs to write programs to help keep track of it all. Really he was probably bored while I painted furniture and build my wife a felt wall ...

This really is a nifty little program. It really helped me see how often there was heavy radio traffic at places like Pearl Harbor. For the Allies, I think it would be an excellent tool.

Wa




aprezto -> RE: Introducing Intel Monkey (9/3/2012 10:43:44 PM)

Witpqs has made an awesome and easy to use tool. I thought having to install Python might be a hurdle, but that's as simple as download and choose run, then the downloaded Intelmonkey just goes.

Having the archive switch turned on would have been useful, but from here on, not having to keep a handle on what intel I saw on a potential target will be great.

Cheers




Dan Nichols -> RE: Introducing Intel Monkey (9/3/2012 11:07:41 PM)

It does not seem to work with multiple day turns. It works fine with my one day per turn game, but not with my 2 day per turn game.




witpqs -> RE: Introducing Intel Monkey (9/3/2012 11:44:57 PM)

quote:

ORIGINAL: Dan Nichols

It does not seem to work with multiple day turns. It works fine with my one day per turn game, but not with my 2 day per turn game.

I never did that. Seems to me like it would be a difference in the way the files are named. I'll fire up a 2-day turn game and have a look. Not sure I'll get to do it this afternoon.




witpqs -> RE: Introducing Intel Monkey (9/4/2012 12:00:05 AM)

OK, I ran the test. Multi-day turns produce files that are in a bit different format. Instead of one file per day, they have a break inside with the new date. I'll update the program to handle that. Later tonight or tomorrow I suspect.




witpqs -> RE: Introducing Intel Monkey (9/4/2012 2:01:01 AM)

quote:

ORIGINAL: Dan Nichols

It does not seem to work with multiple day turns. It works fine with my one day per turn game, but not with my 2 day per turn game.

OK, done and tested for 2-day and 3-day turns. There is a new download link in the first post.

Let me know how it works for you!




Dan Nichols -> RE: Introducing Intel Monkey (9/4/2012 2:14:17 AM)

Works fine, thank you.




dr.hal -> RE: Introducing Intel Monkey (9/4/2012 9:37:43 PM)

How does this compare to the program tracker???




witpqs -> RE: Introducing Intel Monkey (9/4/2012 9:59:14 PM)

Tracker is wonderful and I use it literally every turn. I find that after about 3 or 4 game months I have to wipe out the Tracker database and start over. This is because the Tracker database gets so large it begins to take geometrically longer to start up.

A small portion of what Tracker does is handle the SigInt files. It handles an enormous amount of other data and is amazingly useful. As far as I know it does not handle the combat reports, operations reports, or events reports.

Intel Monkey will stay devoted to Intel stuff. It was only born between 2 and 3 weeks ago so has only the first cut of functionality. Currently it handles the SigInt files, reading in all of them from the save/archive folder for AE. I'm working up a road map of additional functionality that I will share soon. Basically the notion is to process all of the report files produced by turn resolution/replay, and then provide functions that help a player look at useful views of that information.

BTW, 2 years ago IIRC the tracker team mentioned that tracker was then about 50,000 lines of code. I figure it must be 60 or 70 thousand by now with all the user requests they keep adding (including my requsts BTW! [:)]). Intel Monkey is currently 638 lines total, which includes blank lines and comments to make the code easier to read and maintain/change. So Tracker is on the order of about 100x Intel Monkey. Intel Monkey is aimed at a niche, and I hope for it to be very useful there.

Lots of players look or search through the SigInt files in save/archive to see what opposition they might face when conducting invasions, etc (this pertains more to the Allied player as the IJ SigInt is rather sparse). The current version of Intel Monkey combines all those reports into one and lets you sort the lines (records) in useful ways. You will never need to manually search through multiple SigInt files again.

And because Intel Monkey uses Python whereas Tracker uses Java, you will never have to worry about a needed update of one language affecting the other program.




Skyros -> RE: Introducing Intel Monkey (9/4/2012 10:50:49 PM)

Can I just copy the files generated in the save folder into the archive folder to cover the turns prior to adding -archive to the command line?




witpqs -> RE: Introducing Intel Monkey (9/4/2012 11:24:26 PM)

quote:

ORIGINAL: Skyros

Can I just copy the files generated in the save folder into the archive folder to cover the turns prior to adding -archive to the command line?

Yes - but the "-archive" switch essentially does that for you each turn.

BTW, Intel Monkey looks for them to be named the way AE names them, so that it knows which ones to read.




dr.hal -> RE: Introducing Intel Monkey (9/5/2012 2:02:25 AM)

This is outstanding feedback witpqs, thanks.... Hal




witpqs -> RE: Introducing Intel Monkey (9/5/2012 3:36:16 AM)

I've uploaded another version 0.2.2e (link in my signature and in the first post of this thread).

I noticed that the SigInt files are created with some variation in how they present map hex addresses. I see at least four different cases. Here are examples.

quote:


4/Kimura Det is loaded on a Ehime Cargo class xAK moving to Legaspi.
8th Engineer Regiment is located at Changchun(106,41).
Radio transmissions detected at Chumphon (52,66).
Radio transmissions detected at 204,68.

No hex at all, a hex in parentheses with no leading space, a hex in parentheses with a leading space, and a hex with a leading space but no parentheses.

These two cases would sort differently, messing up the display when the player had selected Target/Date sorting:
quote:


4th Engineer Regiment is located at Chumphon(52,66).
Radio transmissions detected at Chumphon (52,66).

Because of the difference between a " " and a "(", you would see all the "Chumphon (52,66)" records first, in date order, and then following them all of the "Chumphon(52,66)" records, in date order.

So, I have added more processing of any hex address present to ensure that all hex addresses have a leading space and are surrounded by parentheses. More or less in this style:
quote:


Radio transmissions detected at Chumphon (52,66).


One additional change, yesterday I rushed out a change to handle multi-day turn files. Today I noticed that Intel Monkey was indeed processing the records correctly but was miscounting the days as displayed in the top left corner of the screen. That has been corrected.




Canoerebel -> RE: Introducing Intel Monkey (9/5/2012 10:47:45 AM)

When I say the title of this thread, I mistakenly thought it might be related to the "Honey Boo Boo" thread.  I mean, "Intel Monkey"? 

I was wrong!  Witpqs, thanks for doing this.  I'll give it a try when I'm back on the game tomorrow.




witpqs -> RE: Introducing Intel Monkey (9/9/2012 5:16:38 AM)

Here is a new release of Intel Monkey, V0.2.2h. The functionality is basically the same as the previous release, but there is now a top level window in place with options for the first four basic reports, of which the basic SigInt report is currently implemented. All of the internal groundwork has now been laid and work now begins on the basic combat report.

This new version also cleans up the works files, currently leaving nothing behind when it finishes. At some point Intel Monkey will have a permanent database so it does not have to read in all files each time it is run.

https://docs.google.com/open?id=0ByVleYydeDVcQ21wZW5JT3NNTkU




RogerJNeilson -> RE: Introducing Intel Monkey (9/9/2012 6:37:53 AM)

Ok copied all the sigint files stored elsewhere into the archive folder, run Intel Monkey and its picked them all up. Great.

Am I right in thinking that any new version is simply downloaded over the top of the previous one?

Roger




RogerJNeilson -> RE: Introducing Intel Monkey (9/9/2012 6:47:39 AM)

Ok the new version looks nicer and I can see where the next reports are. And yes, i just downloaded it over the top of the previous one.

Roger




witpqs -> RE: Introducing Intel Monkey (9/9/2012 4:01:58 PM)

Right! You answered that before I saw the question. The program file (or files in the future) should always be a copy over top of the prior one. I'm also being careful to not rely on storing data until I feel sure that's it's in a format that will not require the player to perform any special procedure for later updates.

Glad you like the look of it! I had a version with bold column headings, then changed them when I found it was difficult (at least for me at the time) to ensure they would behave properly on other people's systems and went with the different color for headings instead. It was right after that when aoffen mentioned using IM on a system that has very different specs indeed than my own Windows-7 environment!





JocMeister -> RE: Introducing Intel Monkey (9/9/2012 6:25:38 PM)

This is fantastic work witpqs! Thank you for the effort! [:)]





JocMeister -> RE: Introducing Intel Monkey (9/14/2012 8:52:10 PM)

Is there any way to get the program to read directly from the sigint files?




witpqs -> RE: Introducing Intel Monkey (9/14/2012 9:27:24 PM)

quote:

ORIGINAL: JocMeister

Is there any way to get the program to read directly from the sigint files?

Uh, it does read directly from the ones in the archive sub-folder, which includes the current turn (meaning the turn resolution/combat replay that just ran). Could you explain a bit more what you are looking for?




JocMeister -> RE: Introducing Intel Monkey (9/15/2012 7:46:03 AM)

Ah,

Sorry for being a bit unclear. I havn´t been using the -archive switch in my game. When I turned it on it was only archiving the latest turn and I wanted to add all the previous sigint to the tool.

But I worked if I just manually copied the asigint from the SAVE folder to the SAVE/Archive folder! [:)]




RogerJNeilson -> RE: Introducing Intel Monkey (9/15/2012 8:40:01 AM)


quote:

ORIGINAL: JocMeister

Ah,

Sorry for being a bit unclear. I havn´t been using the -archive switch in my game. When I turned it on it was only archiving the latest turn and I wanted to add all the previous sigint to the tool.

But I worked if I just manually copied the asigint from the SAVE folder to the SAVE/Archive folder! [:)]



I have started using the -archive switch now, and have simply copied previous sigint files into the archive folder. The programme is happy to read them all.

Rogerer




witpqs -> RE: Introducing Intel Monkey (9/15/2012 5:40:07 PM)

The SigInt files that get read in are basically: side + "sigint" + anything + ".txt"

I'm 99% sure that 'anything' could also be nothing at all but I never tested that (it would just be a file named either "asigint.txt" or "jsigint.txt").

The target folder can also be changed by you, if you edit the .py file. But I figure the archive folder is the most natural place to target.

Been working on the basic Combat Report portion, which is way more complicated than the basic SigInt part. Progress is good.




witpqs -> RE: Introducing Intel Monkey (New Version: 0.4.0) (9/22/2012 2:06:06 AM)

There is a new version of Intel Monkey ready to use.

Here is the link, which I've also updated in my signature (I'm not sure how long that takes to update).
https://docs.google.com/open?id=0ByVleYydeDVceV95RVVDdlVTNHc

This version is 0.4.0, and includes the first cut of Combat Report functionality. For those of you upgrading from a previous version, read the bit below about running the included utility to generate a Bases.txt file for the scenario you are playing. It only takes a few seconds and is very easy for non-technical players to do.

Here is the documentation text:
quote:


2012-09-21

Intel Monkey V0.4.0

Intel Monkey is a program for WITP-AE players to help facilitate digesting Intel provided in the various reports (SigInt, Combat, Operations, Events).

Intel Monkey is written in Python, beginning with Python version 3.2.3 and requires that version of Python or higher be installed in order to run Intel Monkey. It is technically independent of the Windows operating system, but as AE is a windows only program I doubt that Intel Monkey will be used on either Linux or Mac OS.

The program reads in the player's report files that AE archives every turn. Those files are located in "save/archive" (in AE's main folder find folder "save", inside that folder find folder "archive").

Your AE shortcut must have the "-archive" switch for AE to create those files every turn.
__________
Requirement: Python version 3.2.3 or above. You may obtain this at

Sources: python.org (free and open source, and where I obtained it)
At the moment this is current version:
http://python.org/ftp/python/3.2.3/python-3.2.3.msi

OR
www.activestate.com/activepython/downloads
This is also free and a highly regarded distribution.

Install Python per the instructions. Also, although the instructions do not say so, on my system I had to reboot after installation so that the system's path was properly updated to run Python.
__________
Intel Monkey currently consists of three program files (.py) and this documentation file. There are two copies of the main Intel Monkey program, and also a utility program called "GetBasesFromScenario.py" that you will need to get started. In addition, the .zip or .7z will also include "witploadAE.exe" and its documentation file.
__________
Installation:

- In your main WITP-AE folder there is a folder call "tools". Navigate into that folder. That is the place where tools like Staff Assistant and Tracker are typically installed, and is a good place for Intel Monkey.

- Create a folder there called "Intel Monkey".

- Navigate into the "Intel Monkey" folder that you just created.

- Copy the Intel Monkey files (and witploadAE) into the "Intel Monkey" folder. If they are in a .zip or .7z file then you might need to "Extract Files Here" as needed.

Intel Monkey is now installed, and you now need to create a "Bases.txt" file for the scenario you are playing. Run the program "GetBasesFromScenario.py" (by double-clicking on it). Then just tell it where your AE scenario folder is, (usually called "SCEN" under the main AE folder) where you Intel Monkey is (that will already be the default), and the 3-digit scenario number that you are playing. Press the 'Proceed' button and within a few seconds it will create the Bases.txt file you need.

The two .py files you see are identical except one (-A) is configured to read in the Allied reports and the other (-J) is configured to read in the Japanese reports. The easiest way to proceed is to create a shortcut to the version you plan to use, and put the shortcut with your other AE shortcuts. Note: Because the combat report functionality can provide information about both sides, you might want to use both 'your' Intel Monkey and the 'enemy' version so you can review what information the other side has been getting from the combat reports.

To create a shortcut just Right-click on the correct Intel Monkey version (-A or -J) and select "Create shortcut" from the menu. A shortcut will be created right there in the Intel Monkey folder. You can then move that shortcut to anyplace you wish. You can even rename it if you like.

Intel Monkey will also work with multiple AE installs, just like Tracker and other utilities. Simple install it once for each instance of AE.
__________
Current State and Use Instructions:

The program reads files from AE's "save/archive" folder. Make certain you play AE with the "-archive" switch or else those files will not be created and there will be nothing to read.

Intel Monkey is still very new and has a very small set of functions compared to what is intended. Currently Intel Monkey processes all of the player's SigInt files and combat report files. Future versions will process other files as well.

- When started, Intel Monkey will display a small top level window with options for the various reports. Currently there are the Basic SigInt and Basic Combat Report functions implemented.

- When you click on the Basic SigInt button, Intel Monkey will take several seconds to read in all the SigInt files.

- A GUI window will open, where the information is displayed.

- Each line from each SigInt file has been made into its own record with the date at the front, and parsed into fields containing the various information. Note that some of the line come with four pieces of information (including the date) while others come with six (including the date).

- Buttons in the lower left corner allow the report to be sorted according to the criteria noted next to each button.

- You can click in the "Enter Search Text" box and type in something to search for. The first occurrence from the top (in the currently selected sort order) will be found and positioned at the top of the screen (unless too near the bottom of the report). The search is case insensitive (upper/lower case does not matter).

- The report can be scrolled using the scroll bars, or just click inside it to use the keyboard (PageUp, PageDown, etc.) or the mouse wheel if your mouse has one.

- You can select text in the report and copy it a) to some other program or text editor (useful if you are making notes for yourself), or b) into the search text entry area (useful to search for something you see now that causes you to want to change the sort order and look at all similar things).

- When finished, click on either the Exit button or the X in the upper right-hand corner to close the report you are viewing. When you do that to the top windown, Intel Monkey will close.

- The Basic Combat report displays very similarly to the SigInt report. There are some differences. First, the Combat Report takes longer to process than does the SigInt report. Second, The Combat Report has multiple options. Currently implemented are the options for Ship information and LCU information. Battle, Troop, and Aircraft information functions are not yet implemented.

- Note Well: While I believe that all ship location information is captured from the combat reports, the same is not true for LCU location information. Presently only Ground Combat locations for LCUs is captured. LCU locations revealed during combat reports of battle types of naval bombardment, air attacks, amphibious landings, and so on are not yet captured. Doing so is not straighforward because the combat report does not always provide clues as to which side the LCUs belong to. I look forward to increasing the amount of information captured with future versions.

There are many additional functions planned for Intel Monkey, including reading in and processing the other reports. The present functions are very useful already as they allow a player to see SigInt reports for a specific base, or all reports for a specific enemy unit, and so on.






RogerJNeilson -> RE: Introducing Intel Monkey (New Version: 0.4.0) (9/22/2012 7:45:46 AM)

Getting a problem when running the bases file:

Input folder pointed to Scen file
Output folder pointed to Intel Monkey folder
Scen set at 001 - standard campaign

Roger

[image]local://upfiles/41758/C07FD58F33BE45ED979F56BF2223409D.jpg[/image]




witpqs -> RE: Introducing Intel Monkey (New Version: 0.4.0) (9/22/2012 2:59:41 PM)

Edited to add:

It looks to me like you do not have the "witploadAE.exe" file in your Intel Monkey folder. It was included in the .zip file, so try adding it in there.


Roger,

I tested with scenario 1 also, worked fine. Some other folks tested it for me, too.

I'm going to PM you - maybe you can give me some screen shots?

quote:

ORIGINAL: Roger Neilson 3

Getting a problem when running the bases file:

Input folder pointed to Scen file
Output folder pointed to Intel Monkey folder
Scen set at 001 - standard campaign

Roger

[image]local://upfiles/41758/C07FD58F33BE45ED979F56BF2223409D.jpg[/image]





witpqs -> RE: Introducing Intel Monkey (New Version: 0.4.0) (9/22/2012 3:32:48 PM)

That's it, Roger. I just duplicated the error here by renaming witploadAE to something else. Just go back to the .zip file and make sure you pull out witploadAE and it will be fine. (Pulling out the witploadAE text file for reference in case you want to use it for something else is a good idea too.)

[image]local://upfiles/14248/201C4CA3CB7E47C6B7FB8D0A18F6E976.jpg[/image]




RogerJNeilson -> RE: Introducing Intel Monkey (New Version: 0.4.0) (9/22/2012 6:00:30 PM)

Yes that sorted it, thanks

Roger




Page: [1] 2 3 4 5   next >   >>

Valid CSS!




Forum Software © ASPPlayground.NET Advanced Edition 2.4.5 ANSI
0.9023438