[Skimmertalk] software to manage raw data files

[paul_group]

Id prefer the daily report to be available as well or i need to re write my code to add the files together.


------- Original message -------
> From: Pete Smith N4ZR <n4zr at contesting.com>
> To: hremijn at xs4all.nl
> Cc: felipe at dxwatch.com, skimmertalk at contesting.com
> Sent: 23.2.'12,  19:04
> 
> We can certainly look into that, Henk.  I'm forwarding this to Felipe.  
> As you say, it presumably will not be difficult to do
> 
> 73, Pete N4ZR
> The World Contest Station Database, updated daily at www.conteststations.com
> The Reverse Beacon Network at http://reversebeacon.net, blog at reversebeacon.blogspot.com,
> spots at telnet.reversebeacon.net, port 7000 and
> arcluster.reversebeacon.net, port 7000
> 
> 
> On 2/23/2012 1:06 PM, Henk Remijn PA5KT wrote:
>> If you have Access available and know how it works it is a nice tool.
>>
>> The costs for a license for Office home use (without access) is E139,-,
>> license for office professional (with Access) is 699,-.
>> I'd rather spent that money difference on improvement of the
>> conteststation then use it as expensive data analyze tool.
>>
>> When I run contests I want to know after the contest:
>> How was my signal compared to other PA and ON stations? (I am close to
>> the ON border).
>> For the regular cluster, was I spotted wrong?
>>
>> In case I have my own cluster running, who did I spot?
>>
>> In all 3 cases I pick a filter string, use grep to filter and create new
>> files. Then look at these with Excel.
>> The grep thing is done on my unix server and indeed you need some
>> programming skills.
>>
>> Pete, would it be possible if the rawdata files are longer than the
>> excel limit to cut them already in parts on the rbn? I am sure Felipe
>> can program that in Perl?
>> Then excel users can manipulate seperate files and filter them to get
>> smaller files.
>>
>> 73 Henk PA5KT
>>
>>
>> Op 22-02-2012 22:45, Pete Smith N4ZR schreef:
>>> Which is why Access is your best bet.  I did all my analysis on the CQWW
>>> CW (1.8 +1.7 million lines) with Access.
>>>
>>> 73, Pete N4ZR
>>> The World Contest Station Database, updated daily at www.conteststations.com
>>> The Reverse Beacon Network at http://reversebeacon.net, blog at reversebeacon.blogspot.com,
>>> spots at telnet.reversebeacon.net, port 7000 and
>>> arcluster.reversebeacon.net, port 7000
>>>
>>>
>>> On 2/22/2012 10:30 AM, Jorge Diez - CX6VM wrote:
>>>> Thanks Mark,
>>>>
>>>> The original idea was to have ONE file, so I can filter by columns with data
>>>> of all the contest.
>>>>
>>>> 73,
>>>> Jorge
>>>>
>>>>
>>>> -----Mensaje original-----
>>>> De: skimmertalk-bounces at contesting.com
>>>> [mailto:skimmertalk-bounces at contesting.com] En nombre de Mark Bailey
>>>> Enviado el: Miércoles, 22 de Febrero de 2012 01:10 p.m.
>>>> Para: skimmertalk at contesting.com
>>>> Asunto: Re: [Skimmertalk] software to manage raw data files
>>>>
>>>> The GnuUtils package has a program called "split" which will split a
>>>> single file (in this case, a large .csv file) into chunks of any number
>>>> of lines.
>>>>
>>>> You can install GnuUtils from the "Setup" link on
>>>> http://gnuwin32.sourceforge.net/packages/coreutils.htm
>>>>
>>>> "c:\program files\Gnuwin\bin" has to be in the path.
>>>>
>>>> split -l 1000000 20120218.csv
>>>>
>>>> will split the csv file into chunks of 1000000 lines.  Excel can read
>>>> those.  The files end up with names like "xaa", "xab", etc..
>>>>
>>>> 73,
>>>>
>>>> Mark, KD4D
>>>>
>>>> On 2/22/2012 9:49 AM, Paul_group wrote:
>>>>> On 22/02/2012 03:57, Luc Moreira wrote:
>>>>>> OpenOffice can do the job. No row limit and fast filtering RBN raw data.
>>>>>>
>>>>>> http://www.openoffice.org/download/index.html
>>>>>>
>>>>>> 73, Luc
>>>>>>
>>>>> As far as I can see, OpenOffice calc 3.3 is limited to 1048575 rows
>>>>> which allows you to see about 75% of the data in a busy contest / day
>>>>> (00:00UTC to 20:16UTC on the 18th Feb for example)
>>>>>
>>>>> I may be missing something.
>>>>>
>>>>> --
>>>>> 73 de Paul GW8IZR  IO73TI
>>>>> http://www.gw8izr.com
>>>>> _______________________________________________
>>>>>
> _______________________________________________
> Skimmertalk mailing list
> Skimmertalk at contesting.com
> http://dayton.contesting.com/mailman/listinfo/skimmertalk