[Clipart] Help with the script - was: Re: A couple of server problems

Alan alan at ccnsweb.com
Wed Feb 20 08:01:55 PST 2008


Is there storage space to copy the svg and svgz files into a separate 
location say every 24 hours?

Automate the copy to happen once every 24 hours and then tarball from 
the copied files.

Nicu Buculei wrote:
> Frederik Elwert wrote:
>   
>> I haven't tried it, but I think xargs might be the wrong choice. It may
>> call tar multiple times, each time with some of the arguments. This
>> results in a final archive containing only the last files.
>>
>> You could use tar's -T/--files-from parameter to read the files from
>> filelist.txt
>>     
>
> Thanks Frederik, it worked!
>
> Now on http://download.openclipart.org/downloads/ is a tarball named 
> daily_SVG_snapshot.tar.bz2 which can be downloaded to get a snapshot of 
> the current submissions. It is quite large, 156 MB, will extracting 
> about 600MB and contains over 8000 images (some submissions have more 
> than one single SVG).
> I submitted a support request and it will be set to be updated daily.
>
> If someone can help wit a better version of the script, it will be 
> appreciated.
>
> The problem is: we have a directory  named "people" containing a lot of 
> files and subdirectories.
> The files in the root of the directory are not interesting, they are 
> failed uploads and temporary files. The subdirectories contain clipart 
> files (svg and svgz) and other not needed files (png, jpg, whatever - 
> avatars, screenshots, thumbnails).
> We need a tarball containing *only* the SVG and SVGZ files from 
> *subdirectories* and nothing else (the size is already large).
>
> I did it by running a find for *.svg and another for *.svgz, dump the 
> result in a text file and run tar with this text file as an input list.
>
> The weakness is that creating this tarball take a noticeable time (a few 
> minutes) and if some user deletes or renames an existing file (included 
> in that dumped find result) the tar operation will fail (it happened to 
> me the other day). Any idea?
>
>   



More information about the clipart mailing list