/[cvs.andrew.net.au]/disruptive/allhomes/getmore
ViewVC logotype

Contents of /disruptive/allhomes/getmore

Parent Directory Parent Directory | Revision Log Revision Log


Revision 1.3 - (show annotations)
Tue Apr 26 12:38:21 2005 UTC (17 years, 3 months ago) by mikal
Branch: MAIN
CVS Tags: HEAD
Changes since 1.2: +3 -3 lines
Mikal: New scripts

1 #!/bin/bash
2
3 # Get one new allhomes record, and fail if the record couldn't be found
4 # Copyright (C) Michael Still 2005
5 # Written 25 February 2005
6
7 count=`cat upto.high`
8 count=$(( $count + 1 ))
9 filename="ah?a=sprpf&p=$count"
10
11 rm -f "$filename.*" 2> /dev/null
12 wget "http://allhomes.com.au/c/$filename" -U "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.7.5) Gecko/20041217"
13 #cvs add $filename
14 sleep 5
15
16 if [ `grep -i "404 document not found" "$filename" | wc -l | tr -d " "` -lt 1 ]
17 then
18 echo "Strip"
19 ./strip $filename
20 #cvs add $filename.strip
21
22 echo "Simplify"
23 ./simplifyone $filename.strip
24 #cvs add $filename.strip.simple
25 fi
26
27 echo $count > upto.high

  ViewVC Help
Powered by ViewVC 1.1.22