[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: [OT] C++ programming: keeping count of data items read from file



-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 05/09/08 22:47, H.S. wrote:
> s. keeling wrote:
> 
>>
>> That's almost trivial.  The datasets you see in the petrochemical
>> industry can be in the terabyte range.  They're so big, they have to
>> edit in place, not write another output file.  perl handles even this
>> well.  I/O performance is pretty much hardware bound.  This is binary
>> data, btw.  Seismic data.
> 
> Interesting. Never had chance to see this kind of applications. Is this
>  about doing signal processing and pattern recognition with that data?

Maybe.  What I do know is that Perl's regex functionality has been
*highly* optimized over the years.  So, if the task is pattern
matching over large datasets, Perl is the language to use, even over
compiled languages.

> BTW, is that tera byte denoting one single file?

Probably not.  A monolithic TB-range file would be too unwieldy to
manage.  Doesn't matter, though.

It would be impressive, though!!!!

- --
Ron Johnson, Jr.
Jefferson LA  USA

We want... a Shrubbery!!
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)

iD8DBQFIJaSdS9HxQb37XmcRAo+BAJsHT2Md7ONlbl+uPJv0qgqcrIjWiACdEcci
IB5+GWzEeQ3VpcwGmO5nmHY=
=pb9r
-----END PGP SIGNATURE-----


Reply to: