/[cvs.andrew.net.au]/disruptive/allhomes/getmore
ViewVC logotype

Annotation of /disruptive/allhomes/getmore

Parent Directory Parent Directory | Revision Log Revision Log


Revision 1.3 - (hide annotations)
Tue Apr 26 12:38:21 2005 UTC (17 years, 5 months ago) by mikal
Branch: MAIN
CVS Tags: HEAD
Changes since 1.2: +3 -3 lines
Mikal: New scripts

1 mikal 1.1 #!/bin/bash
2    
3     # Get one new allhomes record, and fail if the record couldn't be found
4     # Copyright (C) Michael Still 2005
5     # Written 25 February 2005
6    
7     count=`cat upto.high`
8     count=$(( $count + 1 ))
9 mikal 1.2 filename="ah?a=sprpf&p=$count"
10 mikal 1.1
11     rm -f "$filename.*" 2> /dev/null
12     wget "http://allhomes.com.au/c/$filename" -U "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.7.5) Gecko/20041217"
13 mikal 1.3 #cvs add $filename
14 mikal 1.1 sleep 5
15    
16     if [ `grep -i "404 document not found" "$filename" | wc -l | tr -d " "` -lt 1 ]
17     then
18     echo "Strip"
19     ./strip $filename
20 mikal 1.3 #cvs add $filename.strip
21 mikal 1.1
22     echo "Simplify"
23 mikal 1.2 ./simplifyone $filename.strip
24 mikal 1.3 #cvs add $filename.strip.simple
25 mikal 1.1 fi
26    
27     echo $count > upto.high

  ViewVC Help
Powered by ViewVC 1.1.22