Matrix Games Forums

 Forums  Register  Login  Photo Gallery  Member List  Search  Calendars  FAQ 

My Profile  Inbox  Address Book  My Subscription  My Forums  Log Out

Intel Monkey 1.0 Pre-Beta

 
View related threads: (in this forum | in all forums)

Logged in as: Guest
Users viewing this topic: none
  Printable Version
All Forums >> [New Releases from Matrix Games] >> War in the Pacific: Admiral's Edition >> Intel Monkey 1.0 Pre-Beta Page: [1] 2 3 4 5   next >   >>
Login
Message << Older Topic   Newer Topic >>
Intel Monkey 1.0 Pre-Beta - 11/15/2017 3:22:19 AM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline 		Calling this Pre-Beta but it's had a heck of a workout and lots of development. Have a look.

https://sites.google.com/view/staffmonkeys/home

Special thanks to forum members Roger Neilson aka Roger Neilson 3 (formerly Roger Neilson and Roger Neilson 2) and Walter Eardley aka Andav (better known to my AAR readers as the Devious Admiral Wa) They have provided assistance of all kinds for the past 4 1/2 months. Their advice, testing, and general able assistance has made Intel Monkey gel into a smooth application.




Edit to post new link: https://sites.google.com/view/staffmonkeys/home

Attachment (1)

< Message edited by witpqs -- 11/17/2017 5:21:29 PM >

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home
Post #: 1
RE: Intel Monkey 1.0 Pre-Beta - 11/15/2017 10:44:26 AM   
Bullwinkle58


Posts: 11302
Joined: 2/24/2009
Status: offline
quote:

ORIGINAL: witpqs

Calling this Pre-Beta but it's had a heck of a workout and lots of development. Have a look.

https://sites.google.com/site/staffmonkeys/intel-monkey


Let me give a big +1 to this utility. I've been using the pre-pre-beta for years, and it works great. It does things the other utilities don't. For the Allies especially, pre-invasion looks at islands and what has been reported there over the year(s) is a great help. It sounds like witpqs has made this install even easier by incorporating Python into the installer.

I don't use Monkey every turn, or even every game month. But when you need what it can do you'll be thankful you have it.

_____________________________

The Moose

(in reply to witpqs)
Post #: 2
RE: Intel Monkey 1.0 Pre-Beta - 11/15/2017 1:49:24 PM   
BillBrown


Posts: 2335
Joined: 6/15/2002
Status: offline 		I installed the new version. I had it process new files and it looks like all I got was the sigint files. There is a memory error report in one of the errfile logs
Process CR:
Traceback (most recent call last):
File "multiprocessing\process.py", line 258, in _bootstrap
File "multiprocessing\process.py", line 93, in run
File "lib\IP_procs.py", line 58, in do_combatreport
File "lib\IP_combat_rpt.py", line 510, in __call__
MemoryError

I do have almost 2 years of reports stored for this game. Do I need to crop the reports in the archive folder?
I do have 16 GB of RAM installed, but I think only 2 GB are available in a 32-bit environment.

These are the last few lines in the intel monkey window:

Finished moving data from CSV files to the database.
Get Scenario Data operation completed.
Load Info operation beginning.
Load Bases Info Completed.
Load LCUs Info Completed.
Load Air Groups Info Completed.
Load Aircrafts Info Completed.
Load Ships Info Completed.
Load Info Summary:
Bases Info Loaded.
Lcu_types Info Loaded.
Groups Info Loaded.
Aircraft Info Loaded.
Ships Info Loaded.
Load Info operation completed.
Begin Processing Reports.
SigInt Reports Processed Statistics
FirstDay : 1941-12-07
LastDay : 1943-09-23
DaysProcessed : 656
FilesProcessed : 656
RecordsProcessed : 19,393
Process SigInt Reports Elapsed Time 0:00:01.840804
Finished processing SigInt files.
Error processing AE Combat reports. Consult log files.
Operations files not implemented.
Finished processing Operations files.
Events files not implemented.
Finished processing Events files.
Finished Processing Reports.

< Message edited by BillBrown -- 11/15/2017 1:52:16 PM >

(in reply to Bullwinkle58)
Post #: 3
RE: Intel Monkey 1.0 Pre-Beta - 11/15/2017 4:12:33 PM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline
quote:

ORIGINAL: BillBrown

I installed the new version. I had it process new files and it looks like all I got was the sigint files. There is a memory error report in one of the errfile logs
Process CR:
Traceback (most recent call last):
File "multiprocessing\process.py", line 258, in _bootstrap
File "multiprocessing\process.py", line 93, in run
File "lib\IP_procs.py", line 58, in do_combatreport
File "lib\IP_combat_rpt.py", line 510, in __call__
MemoryError

I do have almost 2 years of reports stored for this game. Do I need to crop the reports in the archive folder?
I do have 16 GB of RAM installed, but I think only 2 GB are available in a 32-bit environment.

These are the last few lines in the intel monkey window:

Finished moving data from CSV files to the database.
Get Scenario Data operation completed.
Load Info operation beginning.
Load Bases Info Completed.
Load LCUs Info Completed.
Load Air Groups Info Completed.
Load Aircrafts Info Completed.
Load Ships Info Completed.
Load Info Summary:
Bases Info Loaded.
Lcu_types Info Loaded.
Groups Info Loaded.
Aircraft Info Loaded.
Ships Info Loaded.
Load Info operation completed.
Begin Processing Reports.
SigInt Reports Processed Statistics
FirstDay : 1941-12-07
LastDay : 1943-09-23
DaysProcessed : 656
FilesProcessed : 656
RecordsProcessed : 19,393
Process SigInt Reports Elapsed Time 0:00:01.840804
Finished processing SigInt files.
Error processing AE Combat reports. Consult log files.
Operations files not implemented.
Finished processing Operations files.
Events files not implemented.
Finished processing Events files.
Finished Processing Reports.

First off, my email address is on the web page (maybe mouse-over my name there). Otherwise PM me and I will give it to you (to avoid spambots picking up email addresses from the forum).

No need to crop the reports. No worry about memory. A separate process is started to process SigInt reports and one to process Combat reports. Because catching up many turns of Combat reports is a huge amount of volume, that process writes records to the database whenever it has 1,000 of any type. It actually uses less memory than most of the reports use.

What almost certainly happened is that it encountered something in a Combat report that it could not handle and barfed on it. I need the logs from that run in the debug folder. When you start Intel Monkey there is a group of files with a similar name under _MAIN, then when the processes start to read in AE reports other groups are created _SI and _CR for SigInt and Combat, respectively. I need the group for _CR.

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to BillBrown)
Post #: 4
RE: Intel Monkey 1.0 Pre-Beta - 11/15/2017 4:21:17 PM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline 		Adding a general note to the reply to Bill Brown:

Loads of unusual, rare, and even erroneous conditions in Combat reports have been found in testing and accommodated. Many conditions that have been fixed by the AE developers are still accommodated for so that old reports can be read in. There must be more lurking out there, and with examples I can make changes to accommodate them.



_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to witpqs)
Post #: 5
RE: Intel Monkey 1.0 Pre-Beta - 11/15/2017 5:13:15 PM   
BillBrown


Posts: 2335
Joined: 6/15/2002
Status: offline 		I only have one file with CR in the name and it only has one line in it. I will send it to you but here it is

Starting at 2017:11:15:13:42:35:986850

(in reply to witpqs)
Post #: 6
RE: Intel Monkey 1.0 Pre-Beta - 11/15/2017 5:59:00 PM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline
quote:

ORIGINAL: BillBrown

I only have one file with CR in the name and it only has one line in it. I will send it to you but here it is

Starting at 2017:11:15:13:42:35:986850

I should have spelled this out better. The file with the abbreviation is a 'marker' to show which groups of logs is which. Notice that the log file names have a date-time stamp in their names so that they sort together in your folder display. I need all the files from the CR group.




Attachment (1)

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to BillBrown)
Post #: 7
RE: Intel Monkey 1.0 Pre-Beta - 11/15/2017 6:02:24 PM   
BillBrown


Posts: 2335
Joined: 6/15/2002
Status: offline 		OK, tonight then.

(in reply to witpqs)
Post #: 8
RE: Intel Monkey 1.0 Pre-Beta - 11/15/2017 7:21:36 PM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline 		Special thanks to forum members Roger Neilson aka Roger Neilson 3 (formerly Roger Neilson and Roger Neilson 2) and Walter Eardley aka Andav (better known to my AAR readers as the Devious Admiral Wa) They have provided assistance of all kinds for the past 4 1/2 months. Their advice, testing, and general able assistance has made Intel Monkey gel into a smooth application.

I updated the first post with the above acknowledgements but I realize that most people will not see the old post again, so I am repeating it here.

Also, I have put a troubleshooting page on the web site with information about the log files.

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to BillBrown)
Post #: 9
RE: Intel Monkey 1.0 Pre-Beta - 11/16/2017 9:01:18 AM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline
quote:

ORIGINAL: BillBrown

I installed the new version. I had it process new files and it looks like all I got was the sigint files. There is a memory error report in one of the errfile logs
Process CR:
Traceback (most recent call last):
File "multiprocessing\process.py", line 258, in _bootstrap
File "multiprocessing\process.py", line 93, in run
File "lib\IP_procs.py", line 58, in do_combatreport
File "lib\IP_combat_rpt.py", line 510, in __call__
MemoryError

I do have almost 2 years of reports stored for this game. Do I need to crop the reports in the archive folder?
I do have 16 GB of RAM installed, but I think only 2 GB are available in a 32-bit environment.

These are the last few lines in the intel monkey window:

Finished moving data from CSV files to the database.
Get Scenario Data operation completed.
Load Info operation beginning.
Load Bases Info Completed.
Load LCUs Info Completed.
Load Air Groups Info Completed.
Load Aircrafts Info Completed.
Load Ships Info Completed.
Load Info Summary:
Bases Info Loaded.
Lcu_types Info Loaded.
Groups Info Loaded.
Aircraft Info Loaded.
Ships Info Loaded.
Load Info operation completed.
Begin Processing Reports.
SigInt Reports Processed Statistics
FirstDay : 1941-12-07
LastDay : 1943-09-23
DaysProcessed : 656
FilesProcessed : 656
RecordsProcessed : 19,393
Process SigInt Reports Elapsed Time 0:00:01.840804
Finished processing SigInt files.
Error processing AE Combat reports. Consult log files.
Operations files not implemented.
Finished processing Operations files.
Events files not implemented.
Finished processing Events files.
Finished Processing Reports.

Fixed.
Processing Combat reports processing was not properly handling a day with no combat.

New version posted to the web site.
New version sha256 hash is:
1240cac98737166d5df4813269c8584101a1f8e4b97b59cdb95b8f3f80e28fb2

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to BillBrown)
Post #: 10
RE: Intel Monkey 1.0 Pre-Beta - 11/16/2017 9:25:11 AM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline 		Noticed that the installer was not writing over old files. Fixed. Posted on the web site.

sha256 hash for IntelMonkeyInstaller.exe
6cc8b5bc9b39a112169667d622ecb967d3c29c99eb0d695ffed48c338b7c7fe5

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to witpqs)
Post #: 11
RE: Intel Monkey 1.0 Pre-Beta - 11/16/2017 1:30:25 PM   
Lowpe


Posts: 22133
Joined: 2/25/2013
Status: offline 		Christmas comes early!

(in reply to witpqs)
Post #: 12
RE: Intel Monkey 1.0 Pre-Beta - 11/16/2017 5:40:47 PM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline 		For those who want to check, I have been including the sha256 hash values of the IntelMonkey.exe file and the IntelMonkeyInstaller.exe file. I've now posted a custom utility to calculate the hash values of those files on your system. It looks for those files in the folder where you run it and if it finds them displays their hash values.

https://sites.google.com/site/staffmonkeys/intel-monkey/intelmonkeyhash-utility

This can be useful if you want to see if you have the same version of IntelMonkey.exe and IntelMonkeyInstaller.exe as the ones on the web site. During these early months of development there might be many updates to Intel Monkey.

< Message edited by witpqs -- 11/16/2017 5:43:13 PM >

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to Lowpe)
Post #: 13
RE: Intel Monkey 1.0 Pre-Beta - 11/17/2017 6:37:13 AM   
RogerJNeilson


Posts: 1277
Joined: 4/12/2012
From: Bedlington, Northumberland, UK
Status: offline 		Got to say I am very surprised by the low level of response to this, You guys need to try it.... I could go on at length but won't at this point.

Roger

_____________________________

An unplanned dynasty: Roger Neilson, Roger Neilson 11, Roger Neilson 3 previous posts 898+1515 + 1126 = 3539.....Finally completed my game which started the day WITP:AE was released

(in reply to witpqs)
Post #: 14
RE: Intel Monkey 1.0 Pre-Beta - 11/17/2017 9:30:43 AM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline 		A little appetite whetting...

Above you've seen the log files for troubleshooting. A startup pictorial will come later. Now for a little bit about normal operations.

Here is the main menu. Notice the report buttons in the top area and the more administrative buttons in the lower area. The large box for a message area let's you know what is going on.

On the right of the header area you see "Test Game". That's user-selectable text to help you keep things straight when you have multiple games going and have more than one Intel Monkey open.




Attachment (1)

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to RogerJNeilson)
Post #: 15
RE: Intel Monkey 1.0 Pre-Beta - 11/17/2017 9:31:48 AM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline 		If you vertically stretch the window, the message area takes all of the additional space.




Attachment (1)

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to witpqs)
Post #: 16
RE: Intel Monkey 1.0 Pre-Beta - 11/17/2017 9:32:25 AM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline 		The message area scrolls in case you want to review something.




Attachment (1)

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to witpqs)
Post #: 17
RE: Intel Monkey 1.0 Pre-Beta - 11/17/2017 9:36:22 AM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline 		The configuration menu. These are user configuration items. When you configure "AE Home" doing so will also automatically configure the items in the same group. If you are doing testing like I was when I took this pic, you might then set "archive" to point somewhere else, but normally you would just leave it pointing to "SAVE/archive".




Attachment (1)

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to witpqs)
Post #: 18
RE: Intel Monkey 1.0 Pre-Beta - 11/17/2017 9:39:33 AM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline 		Database maintenance. If and when you want to create a new database all you have to do is push a button. The old database will be renamed (-old##) in case you change you mind or made a mistake.

As Intel Monkey is further developed new features will be added, and some of those will require new database tables and fields. After an Intel Monkey upgrade the databases can be brought up to the new specs with a click.




Attachment (1)

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to witpqs)
Post #: 19
RE: Intel Monkey 1.0 Pre-Beta - 11/17/2017 9:40:52 AM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline 		The heart of Intel Monkey is the reports. Everything else exists to bring you the reports. Here is what the SigInt report look like when you first start it.




Attachment (1)

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to witpqs)
Post #: 20
RE: Intel Monkey 1.0 Pre-Beta - 11/17/2017 9:47:46 AM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline 		In the above pic you see on the right side an area where EVERY field can be filtered on and/or sorted on. Filters can be typed in directly on that main report screen, but many times it is easier to click on "Edit" and use the pop-up.

Many pop-ups contain pick lists, like this list of bases. Here you see the result of Wake Island being selected, then submitted by "Enter Selected". That put the filter into the edit box below. Notice the item to be filtered on is between vertical bars |like this|. The first part of a filter is the filter command, in this case INEM, but you never have to fill that in manually (or remember it) unless you want to. More on that later.




Attachment (1)

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to witpqs)
Post #: 21
RE: Intel Monkey 1.0 Pre-Beta - 11/17/2017 9:53:01 AM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline 		After I clicked "Done" the pop-up closed. Back on the main report screen I also clicked on the check mark in the Date filter to change that from "Active" (see earlier pic) to "Inactive". I left the soft selection for Date as it was. Notice the Base filter near the bottom. It is "Active" but not blue like Date was before. Instead it's a lighter color. The lighter color signifies that it has changed since the last time filters and sorts were actually "Executed". It's sort of like giving an assistant a bunch of orders all at once and then finally saying "OK, now go do it!". In Intel Monkey reports "Execute" is "Go do it!".




Attachment (1)

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to witpqs)
Post #: 22
RE: Intel Monkey 1.0 Pre-Beta - 11/17/2017 9:54:55 AM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline 		And here is what things look like after pressing "Execute Active Filters & Sorts".




Attachment (1)

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to witpqs)
Post #: 23
RE: Intel Monkey 1.0 Pre-Beta - 11/17/2017 10:13:09 AM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline 		A little more on the filters pop-up. Notice the buttons INclude/EXclude, Exact/Contains, Match case/No match case. By toggling those choices you control what filter is made. In the prior example we INcluded Wake Island, but we could also have said to Exclude Wake Island and we would have seen all the records where Base was not Wake Island. Here is the break down.

IN means include.
EX means exclude.

E means an exact match. So |Wake Island| would not match "Wake Island Atoll".
C means contains. So |Wake Island| would match "Wake Island Atoll".

M means match case. |wake island| would not match "Wake Island".
N means no match case. |wake island| would match "Wake Island".

Notice just below those radio buttons is a large button that says "Insert Blank Template...". Right now it also says "[INEM ||]", which is the actual blank template it will insert. If you change one of the radio buttons, perhaps switch from Exact to Contains, that will change accordingly, in our example to "[INCM ||]".

But what does it mean to insert a blank template? Press the button and that template will be inserted into the editing just below. Then you can enter your own filter term between the vertical bars. Experiment for yourself. Try out the |wake island| example described above with Match case and No match case to get a feel for how it works.




Attachment (1)

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to witpqs)
Post #: 24
RE: Intel Monkey 1.0 Pre-Beta - 11/17/2017 10:15:12 AM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline 		Earlier you saw the pick list for bases. Here is a different type of pick list. I chopped off this screen pic because the list of ship types is very long so it goes top to bottom of the monitor and you can scroll it even further.




Attachment (1)

< Message edited by witpqs -- 11/17/2017 1:36:05 PM >

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to witpqs)
Post #: 25
RE: Intel Monkey 1.0 Pre-Beta - 11/17/2017 10:16:30 AM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline 		After you click on a ship type the filter will be added to the filter box. In this pic I have also then open up the other pick list for "Ship Groups".




Attachment (1)

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to witpqs)
Post #: 26
RE: Intel Monkey 1.0 Pre-Beta - 11/17/2017 10:21:59 AM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline 		When I clicked on one of them the appropriate filter was inserted. As you can see that filter has multiple terms!

Here are the overall rules. A filter starts with "[". Then comes the four letter command (in this case it is "INEM"). A space " " separates the command and the first filter term, then the term is enclose in vertical bars (for example |DD|). If there are additional filter terms they should be separated from each other by a space " ".

Notice also that we can have multiple filters at once. They are all combined before being given to the database when we pres "Execute".




Attachment (1)

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to witpqs)
Post #: 27
RE: Intel Monkey 1.0 Pre-Beta - 11/17/2017 10:22:40 AM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline 		Here is the main report screen after we pressed "Done".




Attachment (1)

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to witpqs)
Post #: 28
RE: Intel Monkey 1.0 Pre-Beta - 11/17/2017 10:23:08 AM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline 		And then here it is again after we pressed "Execute".




Attachment (1)

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to witpqs)
Post #: 29
RE: Intel Monkey 1.0 Pre-Beta - 11/17/2017 10:32:45 AM   
witpqs


Posts: 26087
Joined: 10/4/2004
From: Argleton
Status: offline 		So how do sorts work? Here is an example.

To make an example that show things clearly I created a filter with all the warship type. Notice the sorts that are active. I wanted to sort by ship type, then ship name, then date.

The SigInt report covers all Sigint so the field names are generic to account for LCU or whatever might show up. "SubjType" will give us the ship type, so that is Active with Sort Level 1. "Subject" will give us the ship name and is Active with Sort Level 2. "Date" is Active with Sort Level 3. Think of Sort Levels as priority: priority 1 is higher than priority 2, and so on.

Look at the results and see how the list sorted as we wanted.




Attachment (1)

_____________________________

Intel Monkey: https://sites.google.com/view/staffmonkeys/home

(in reply to witpqs)
Post #: 30
Page:   [1] 2 3 4 5   next >   >>
All Forums >> [New Releases from Matrix Games] >> War in the Pacific: Admiral's Edition >> Intel Monkey 1.0 Pre-Beta Page: [1] 2 3 4 5   next >   >>
Jump to:





New Messages No New Messages
Hot Topic w/ New Messages Hot Topic w/o New Messages
Locked w/ New Messages Locked w/o New Messages
 Post New Thread
 Reply to Message
 Post New Poll
 Submit Vote
 Delete My Own Post
 Delete My Own Thread
 Rate Posts


Forum Software © ASPPlayground.NET Advanced Edition 2.4.5 ANSI

1.156