Re: file size limit exceeded

[Blake Leverington <leverinb@uregina.ca>]

Thanks Richard,

The issue I ran into is directly related to hddm files. I do not produce 
any hbook or other.  Why I suspected a 2GB limit was when I looked at 
the log files from the jobs I had run I see at the very end "Filesize 
limit exceeded".  I look at the hddm file size and it's slightly larger 
than 2GB. This happened for both bggen and hdgeant. I had thought, like 
you said, that hddm was unlimited, so now I'm suspecting it's the NFS 
filesystem I'm running on (stan@indiana). I guess I'll just have to 
split up my jobs more.

Cheers,
-Blake

Richard Jones wrote:
> Hello all,
>
> There are no file size limits in HDDM, apart from those issuing from 
> the OS/filesystem on which the file is being written.  I know there is 
> no 2GB cutoff because I routinely exceed that limit.  The design of 
> HDDM has unlimited stream length because it is sequential access.  
> Some people, myself included, like to write out ntuples as a 
> side-effect of the simulation, either to monitor conditions in the 
> simulation or do special simulation studies.  If you are looking at 
> the size of the hbook file produced in the simulation, I know that 
> hbook has a hard 2GB filesize limit.  Is that what you are running into?
>
> -Richard Jones
>
>
>
>
> David Lawrence wrote:
>> Hi Blake,
>>
>>     I'm not aware of this functionality being built into HDDM as an 
>> automatic feature, but Richard would know for sure so I'll let him 
>> comment. My only comments would be that I tend to define the number 
>> of events per job based on how quickly I want the job done so time is 
>> the independent variable for me.
>>
>> Regards,
>> -David
>>
>>   
>