[Skimmertalk] software to manage raw data files

[Pete Smith N4ZR]

We can certainly look into that, Henk.  I'm forwarding this to Felipe.  
As you say, it presumably will not be difficult to do

73, Pete N4ZR
The World Contest Station Database, updated daily at www.conteststations.com
The Reverse Beacon Network at http://reversebeacon.net, blog at reversebeacon.blogspot.com,
spots at telnet.reversebeacon.net, port 7000 and
arcluster.reversebeacon.net, port 7000


On 2/23/2012 1:06 PM, Henk Remijn PA5KT wrote:
> If you have Access available and know how it works it is a nice tool.
>
> The costs for a license for Office home use (without access) is €139,-,
> license for office professional (with Access) is 699,-.
> I'd rather spent that money difference on improvement of the
> conteststation then use it as expensive data analyze tool.
>
> When I run contests I want to know after the contest:
> How was my signal compared to other PA and ON stations? (I am close to
> the ON border).
> For the regular cluster, was I spotted wrong?
>
> In case I have my own cluster running, who did I spot?
>
> In all 3 cases I pick a filter string, use grep to filter and create new
> files. Then look at these with Excel.
> The grep thing is done on my unix server and indeed you need some
> programming skills.
>
> Pete, would it be possible if the rawdata files are longer than the
> excel limit to cut them already in parts on the rbn? I am sure Felipe
> can program that in Perl?
> Then excel users can manipulate seperate files and filter them to get
> smaller files.
>
> 73 Henk PA5KT
>
>
> Op 22-02-2012 22:45, Pete Smith N4ZR schreef:
>> Which is why Access is your best bet.  I did all my analysis on the CQWW
>> CW (1.8 +1.7 million lines) with Access.
>>
>> 73, Pete N4ZR
>> The World Contest Station Database, updated daily at www.conteststations.com
>> The Reverse Beacon Network at http://reversebeacon.net, blog at reversebeacon.blogspot.com,
>> spots at telnet.reversebeacon.net, port 7000 and
>> arcluster.reversebeacon.net, port 7000
>>
>>
>> On 2/22/2012 10:30 AM, Jorge Diez - CX6VM wrote:
>>> Thanks Mark,
>>>
>>> The original idea was to have ONE file, so I can filter by columns with data
>>> of all the contest.
>>>
>>> 73,
>>> Jorge
>>>
>>>
>>> -----Mensaje original-----
>>> De: skimmertalk-bounces at contesting.com
>>> [mailto:skimmertalk-bounces at contesting.com] En nombre de Mark Bailey
>>> Enviado el: Miércoles, 22 de Febrero de 2012 01:10 p.m.
>>> Para: skimmertalk at contesting.com
>>> Asunto: Re: [Skimmertalk] software to manage raw data files
>>>
>>> The GnuUtils package has a program called "split" which will split a
>>> single file (in this case, a large .csv file) into chunks of any number
>>> of lines.
>>>
>>> You can install GnuUtils from the "Setup" link on
>>> http://gnuwin32.sourceforge.net/packages/coreutils.htm
>>>
>>> "c:\program files\Gnuwin\bin" has to be in the path.
>>>
>>> split -l 1000000 20120218.csv
>>>
>>> will split the csv file into chunks of 1000000 lines.  Excel can read
>>> those.  The files end up with names like "xaa", "xab", etc..
>>>
>>> 73,
>>>
>>> Mark, KD4D
>>>
>>> On 2/22/2012 9:49 AM, Paul_group wrote:
>>>> On 22/02/2012 03:57, Luc Moreira wrote:
>>>>> OpenOffice can do the job. No row limit and fast filtering RBN raw data.
>>>>>
>>>>> http://www.openoffice.org/download/index.html
>>>>>
>>>>> 73, Luc
>>>>>
>>>> As far as I can see, OpenOffice calc 3.3 is limited to 1048575 rows
>>>> which allows you to see about 75% of the data in a busy contest / day
>>>> (00:00UTC to 20:16UTC on the 18th Feb for example)
>>>>
>>>> I may be missing something.
>>>>
>>>> --
>>>> 73 de Paul GW8IZR  IO73TI
>>>> http://www.gw8izr.com
>>>> _______________________________________________
>>>>