Just to give everyone a perspective on how elaborate a system Mike (NE4S)
has developed for generating the GQP results, here's a bit of what goes on.
This is truly impressive. What a professional process he has developed, and
completed it in such a timely fashion too.
Hat's off to Mike for this grade A effort.
Jeff,
W4DD
-----Original Message-----
From: Michael Condon [mailto:mrcne4s at yahoo.com]
Sent: Sunday, May 06, 2007 12:23 PM
To: Jeff W4DD
Subject: Re: [SECC] GQP Log update, Countys activated.
Hi Jeff,
It used to be a huge task, so I wrote some helpers.
Here is the thumbnail version of how it goes.
I just got log #229 in from Grady, WE4S.
I download the file to a holding folder for edits, and save the note and
attachment in a folder on Yahoo mail.
File edits mean checking State, County, Class/Mode/Power, and getting the
data in acceptable order. I just use mass replace to get things right.
Many files do not need any work, some take a bunch. It is seldom more than
a couple of minutes though.
If the email contained soapbox info, I add it as tagged Soapbox in the Cab
file.
When the file looks good, I move it to a folder where all the good little
files live.
A VB6 Program I made will list the files in the "good" folder, parse them
and show where problems pop up.
I have 11 levels of alias on State/Prov, 6 on County spellings, 4 on club
names, and if any reasonable spelling is found, it is sent on correctly to
the DB, and Access 2003 DB. All calls are made UC, and normalized to strip
off or handle slashes and extraneous trailing stuff... Score, not with
dupes, is checked here and flagged if over or under any claimed. Qs and
Mults are listed.
For rovers I have a packing option where Paul's 40+ files are read and saved
into one file.
If the file passes as a single, I run an option to process all files, and
the folder with the good guys is run through for all the files that live
there.
All the front end checks are done, logs recieved are put into a text file,
soap comments are put into a text file, and a text file of alias and invalid
Qs all get made. On this run, all the Qs are inserted into a table in the
DB, and all the header info is inserted in a table of entrant info,
including address which was picked up on the fly from a query into my FCC
calls table recently downloaded.
This gets the 38,000 's and 229 entrants into two tables. All of the
previous Qs and entrant info is wiped out for a fresh run.
Edit time a few minutes.
The program runs all the files for all processes in less than a minute.
The text files for logs and soap are cut and pasted into FrontPage (minus
Extensions) and WinSCP to the web site.
Front end work done, for Grady's new log, about 6 minutes total.
Then I go into GQP.mdb in Access and run a macro which runs 11 other macros,
which run about 50 queries.
In the DB, all entry tables are erased and created newly on each run. Info
tables like states and county table stay put.
I made most of these queries as small basic steps, so it took more of them,
but bugs are easier to find and fix.
When the big macro is done, all the info is tables for analysis,
spreadsheets are output to a folder for cut and paste into Front page,
All categories, plaque, certificates, score breakdown, and error listings
are out there to punch up.
There are some aspects of log cross checking that are not yet implemented,
it is not full UBN, but soon will be...
At this time, the contest is Scored as of the last log in.
Run time for the back end about a minute too...
So other than handling the variablility of logs sent in, the score takes 2
minutes to run and perhaps a half hour to cut, paste, and upload.
Continuous score updates is on the horizon.
My recent work is to skip the spreadsheets and make custom reports and then
output them as html into page templates in the FrontPage folder. This will
further speed up the process. This year the score will be available an hour
after the last log is in.
It may take me a day or two of sanity checking to feel good about
publishing, and we always wait 2 weeks for postals to creep in.
More front end check will also reduce the edit time as hueristics are added
to address recurring specific situations.
I could push it all into Access, or the VB front end, but for now this
works.
Certificates and mailing lables are now printed directly from the DB, and I
will mail them in a few days of final, much easier than before. The usual
back up and saves keep the work from being lost.
Postal paper logs: John reenters them ALL in NA and sends them to me. I
put up a rule about 100 Qs needing to be Cab files, but since John does the
paper, and I do the maveric email files, all entries get in. We will drop
the 100 rule next time as we have had 3 complaints about it.
Much of the code for this came from my personal logger, "Rover". Now that
the GQP score code is in place, a GQP logging program is around the bend
too. For CW I would just use WinKey as a dongle if I don't find a free DLL.
Thats the short story.
I call it my "recreational programming" and enjoy it greatly.
I am saving this text for later publication too.
Thanks for asking,
73,
Mike, NE4S
Please use ne4s at iham.us or mike1230 at mcnet.us as my address.
Be well,
Thanks
----- Original Message ----
From: Jeff W4DD <w4dd at arrl.net>
To: Michael Condon <ne4s at iham.us>
Sent: Sunday, May 6, 2007 9:39:53 AM
Subject: RE: [SECC] GQP Log update, Countys activated.
Mike,
At some point it would be real interesting to know how you check all the
logs. Do you have some specialized software or perhaps something you wrote.
It sounds like a huge task, but one which you have developed some expertise.
Jeff, W4DD
-----Original Message-----
From: secc-bounces at contesting.com [mailto:secc-bounces at contesting.com] On
Behalf Of Michael Condon
Sent: Sunday, May 06, 2007 9:30 AM
To: SECC GA Club
Subject: [SECC] GQP Log update, Countys activated.
As of Sunday AM, May 6th, there are 228 logs entered in GQP.
The web site has been up dated for logs and soapbox comments.
http://gqp.contesting.com/index.htm
Counties covered....!!
>From logs received so far:
153 of the 159 counties were activated this year.
The 6 counties with "0" Q's reported were:
Atkinson
Berrien
Echols
McDuffie
Seminole
Wilcox
Counties with less than 10 Q's were:
Brantley - 2
Glynn - 3
Pierce - 9
Warren - 2
This list is from the 37,770 QSO's in the logs currently in database.
It is possible some of the "0" counties may have been active, but no logs
with them have come in yet.
And, the counts for less than 10 Q's may change if more logs are received.
As I am still working on the data, the counts may change as I refine my
work. (Fix bugs)
A check of the Rover QSO's shows they were active in 140 counties for 9895
contacts. (Preliminary Info)
For those still holding logs, May 15 th is the last chance!!
>From our response this year, there may not be many logs in the ranks of
SECC/SEDXC not sent in... Thanks!!
My last update from GA will be Tues evening, as we QSY to Colorado for the
summer.
The GQP data is on Yahoo, my laptop, two DVDs, and an external 500GB hard
drive.
Arrival in CO will be May 14th, and we have to get "WildBlue" satellite
internet installed there.
So I may not be able to get back in touch until a couple days after that.
I hope to see the logs hit 230 before I go. That would be 60 more than the
170 of 2006!
Thanks to all, next update when it happens, or on Tuesday....
73,
Mike, NE4S
And... Rovers, I would like to have a few Pics of you and your trusty
Mobiles for the web.
JPG's, uncompressed would be fine, get your selves in the pics too.
All other pics welcome.....
Please use ne4s at iham.us or mike1230 at mcnet.us as my address.
Be well,
Thanks
__________________________________________________
Do You Yahoo!?
Tired of spam? Yahoo! Mail has the best spam protection around
http://mail.yahoo.com
_______________________________________________
SECC mailing list
SECC at contesting.com
http://lists.contesting.com/mailman/listinfo/secc
____________________________________________________________________________
________
It's here! Your new message!
Get new email alerts with the free Yahoo! Toolbar.
http://tools.search.yahoo.com/toolbar/features/mail/
--0-376833556-1178468568=:25679
Content-Type: text/html; charset=ascii
<html><head><style type="text/css"><!-- DIV {margin:0px;}
--></style></head><body><div style="font-family:times new roman, new york,
times, serif;font-size:12pt"><DIV></DIV>
<DIV>Hi Jeff,</DIV>
<DIV>It used to be a huge task, so I wrote some helpers.</DIV>
<DIV>Here is the thumbnail version of how it goes.</DIV>
<DIV> </DIV>
<DIV>I just got log #229 in from Grady, WE4S.</DIV>
<DIV> </DIV>
<DIV>I download the file to a holding folder for edits, and save the
note and attachment in a folder on Yahoo mail.</DIV>
<DIV>File edits mean checking State, County, Class/Mode/Power, and
getting the data in acceptable order. I just use mass replace to
get things right. Many files do not need any work, some take a
bunch. It is seldom more than a couple of minutes though.</DIV>
<DIV>If the email contained soapbox info, I add it as tagged Soapbox in the
Cab file.</DIV>
<DIV> </DIV>
<DIV>When the file looks good, I move it to a folder where all the good
little files live.</DIV>
<DIV>A VB6 Program I made will list the files in the "good" folder, parse
them and show where problems pop up.</DIV>
<DIV>I have 11 levels of alias on State/Prov, 6 on County spellings, 4 on
club names, and if any reasonable spelling is found, it is sent on correctly
to the DB, and Access 2003 DB. All calls are made UC, and normalized
to strip off or handle slashes and extraneous trailing stuff... Score,
not with dupes, is checked here and flagged if over or under any
claimed. Qs and Mults are listed.</DIV>
<DIV> </DIV>
<DIV>For rovers I have a packing option where Paul's 40+ files are read and
saved into one file.</DIV>
<DIV> </DIV>
<DIV>If the file passes as a single, I run an option to process all files,
and the folder with the good guys is run through for all the files that live
there.</DIV>
<DIV>All the front end checks are done, logs recieved are put into a text
file, soap comments are put into a text file, and a text file of alias and
invalid Qs all get made. On this run, all the Qs are inserted
into a table in the DB, and all the header info is inserted in a table of
entrant info, including address which was picked up on the fly from a query
into my FCC calls table recently downloaded.</DIV>
<DIV> </DIV>
<DIV>This gets the 38,000 's and 229 entrants into two tables.
All of the previous Qs and entrant info is wiped out for a fresh run.</DIV>
<DIV>Edit time a few minutes.</DIV>
<DIV>The program runs all the files for all processes in less than a
minute.</DIV>
<DIV> </DIV>
<DIV>The text files for logs and soap are cut and pasted into FrontPage
(minus Extensions) and WinSCP to the web site.</DIV>
<DIV>Front end work done, for Grady's new log, about 6 minutes total.</DIV>
<DIV> </DIV>
<DIV>Then I go into GQP.mdb in Access and run a macro which runs 11 other
macros, which run about 50 queries.</DIV>
<DIV>In the DB, all entry tables are erased and created newly on each
run. Info tables like states and county table stay put.</DIV>
<DIV>I made most of these queries as small basic steps, so it took more of
them, but bugs are easier to find and fix.</DIV>
<DIV> </DIV>
<DIV>When the big macro is done, all the info is tables for analysis,
spreadsheets are output to a folder for cut and paste into Front page,</DIV>
<DIV>All categories, plaque, certificates, score breakdown, and error
listings are out there to punch up.</DIV>
<DIV>There are some aspects of log cross checking that are not yet
implemented, it is not full UBN, but soon will be...</DIV>
<DIV>At this time, the contest is Scored as of the last log in.</DIV>
<DIV>Run time for the back end about a minute too...</DIV>
<DIV> </DIV>
<DIV>So other than handling the variablility of logs sent in, the score
takes 2 minutes to run and perhaps a half hour to cut, paste, and
upload. Continuous score updates is on the horizon.</DIV>
<DIV> </DIV>
<DIV>My recent work is to skip the spreadsheets and make custom reports and
then output them as html into page templates in the FrontPage
folder. This will further speed up the process. This year
the score will be available an hour after the last log is in.</DIV>
<DIV>It may take me a day or two of sanity checking to feel good about
publishing, and we always wait 2 weeks for postals to creep in.</DIV>
<DIV>More front end check will also reduce the edit time as hueristics are
added to address recurring specific situations.</DIV>
<DIV>I could push it all into Access, or the VB front end, but for now this
works.</DIV>
<DIV>Certificates and mailing lables are now printed directly from the
DB, and I will mail them in a few days of final, much easier than
before. The usual back up and saves keep the work from being
lost.</DIV>
<DIV> </DIV>
<DIV>Postal paper logs: John reenters them ALL in NA and sends
them to me. I put up a rule about 100 Qs needing to be Cab files, but
since John does the paper, and I do the maveric email files, all entries get
in. We will drop the 100 rule next time as we have had 3 complaints
about it.</DIV>
<DIV> </DIV>
<DIV>Much of the code for this came from my personal logger, "Rover".
Now that the GQP score code is in place, a GQP logging program is around the
bend too. For CW I would just use WinKey as a dongle if I don't find a
free DLL.</DIV>
<DIV> </DIV>
<DIV>Thats the short story.</DIV>
<DIV>I call it my "recreational programming" and enjoy it greatly.</DIV>
<DIV> </DIV>
<DIV>I am saving this text for later publication too.</DIV>
<DIV> </DIV>
<DIV>Thanks for asking,</DIV>
<DIV>73,</DIV>
<DIV>Mike, NE4S</DIV>
<DIV> </DIV>
<DIV> </DIV>
<DIV><BR> </DIV>Please use ne4s at iham.us or mike1230 at mcnet.us as my
address.<BR>Be well, <BR>Thanks
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times,
serif"><BR><BR>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: times new roman, new york, times,
serif">----- Original Message ----<BR>From: Jeff W4DD
<w4dd at arrl.net><BR>To: Michael Condon <ne4s at iham.us><BR>Sent:
Sunday, May 6, 2007 9:39:53 AM<BR>Subject: RE: [SECC] GQP Log update,
Countys activated.<BR><BR>
<DIV>Mike,<BR><BR>At some point it would be real interesting to know how you
check all the<BR>logs. Do you have some specialized software or
perhaps something you wrote.<BR><BR>It sounds like a huge task, but one
which you have developed some expertise.<BR><BR>Jeff,
W4DD<BR><BR>-----Original Message-----<BR>From: secc-bounces at contesting.com
[mailto:secc-bounces at contesting.com] On<BR>Behalf Of Michael Condon<BR>Sent:
Sunday, May 06, 2007 9:30 AM<BR>To: SECC GA Club<BR>Subject: [SECC] GQP Log
update, Countys activated.<BR><BR>As of Sunday AM, May 6th, there are 228
logs entered in GQP.<BR><BR>The web site has been up dated for logs and
soapbox comments.<BR><A href="http://gqp.contesting.com/index.htm";
target=_blank>http://gqp.contesting.com/index.htm</A> <BR><BR>Counties
covered....!!<BR>>From logs received so far:<BR>153 of the 159 counties
were activated this year.<BR>The 6 counties with "0" Q's reported
were:<BR>Atkinson<BR>Berrien<BR>Echols<BR>McDuffie<BR>Seminole<BR>Wilcox<BR>
<BR>Counties with less than 10 Q's were:<BR>Brantley - 2<BR>Glynn -
3 <BR>Pierce - 9<BR>Warren - 2<BR><BR>This list is
from the 37,770 QSO's in the logs currently in database.<BR>It is possible
some of the "0" counties may have been active, but no logs<BR>with them have
come in yet.<BR>And, the counts for less than 10 Q's may change if more logs
are received.<BR>As I am still working on the data, the counts may change as
I refine my<BR>work. (Fix bugs)<BR><BR>A check of the Rover QSO's
shows they were active in 140 counties for 9895<BR>contacts. (Preliminary
Info)<BR><BR>For those still holding logs, May 15 th is the last
chance!!<BR>>From our response this year, there may not be many logs in
the ranks of<BR>SECC/SEDXC not sent in... Thanks!!<BR><BR>My last update
from GA will be Tues evening, as we QSY to Colorado for
the<BR>summer.<BR>The GQP data is on Yahoo,
my laptop, two DVDs, and an external 500GB hard<BR>drive.<BR>Arrival in CO
will be May 14th, and we have to get "WildBlue" satellite<BR>internet
installed there.<BR>So I may not be able to get back in touch until a couple
days after that.<BR><BR>I hope to see the logs hit 230 before I
go. That would be 60 more than the<BR>170 of 2006!<BR><BR>Thanks
to all, next update when it happens, or on Tuesday....<BR><BR>73,<BR>Mike,
NE4S<BR><BR>And... Rovers, I would like to have a few Pics of you and your
trusty<BR>Mobiles for the web.<BR>JPG's, uncompressed would be fine, get
your selves in the pics too.<BR><BR>All other pics
welcome.....<BR><BR><BR>Please use ne4s at iham.us or mike1230 at mcnet.us as my
address.<BR>Be well,
<BR>Thanks<BR><BR>__________________________________________________<BR>Do
You Yahoo!?<BR>Tired of spam? Yahoo! Mail has the best spam
protection around <BR><A href="http://mail.yahoo.com/";
target=_blank>http://mail.yahoo.com</A>
<BR>_______________________________________________<BR>SECC mailing
list<BR>SECC at contesting.com<BR><A
href="http://lists.contesting.com/mailman/listinfo/secc";
target=_blank>http://lists.contesting.com/mailman/listinfo/secc</A></DIV></D
IV><BR></DIV></div><br>
<hr size=1>No need to miss a message. <a
href="http://us.rd.yahoo.com/evt=43910/*http://mobile.yahoo.com/mail
">Get email on-the-go </a><br>with Yahoo! Mail for Mobile. <a
href="http://us.rd.yahoo.com/evt=43910/*http://mobile.yahoo.com/mail
">Get started.</a></body></html>
--0-376833556-1178468568=:25679--
|