passing headers...help!

[Bryan McCormick]

Ah, I see. I think. But as I've never had to do this before, and presuming 
I'm willing to slog through and experiment, what does the code for this 
look like?

do I do a POST and then pass the URL each time for each?

how do I assemble all these header fields and pass them? are they all CRLF 
separated along the lines of  HEAD&CRLF&SEC&CRLF... that i concatenate 
together? what do I so once i've passed them?  i'm afraid i'm a total babe 
in the woods with this sort of thing.

btw this script is being written strictly as a personal convenience for 
doing some math transforms on the data sets which are totally public. 
unfortunately CBOE by making a handy calendar based script driven interface 
for the casual browser has created a nightmare to get at the data. and 
oddly there isn't even a "pay" alternative for this. you have to go to the 
site and click on the calendar interface to load each day. the alternative 
is hand-posting these into excel which with months of data quickly becomes 
a horrible thing to do.



At 04:30 AM 9/29/02 -0700, you wrote:
>Hello Bryan,
>
>Unlike the new model of Web Services employing the
>SOAP-protocol and its WDSL-declarations, CGI-solutions
>have no fixed way of telling what parameters they
>expect and how they should be formed.
>The only thing you can do, basically, is look at the
>URL, substitute the data with your own and pray that
>if it works, the site doesn't change its CGI at some
>point in the future.
>
>In this case, the cgi program is an .asp file, which
>we find before the question mark. Its parameters are
>divided by ampersands and show their names before the
>equality signs and their content behind.
>So the PageViewer.asp on the server expects the
>parameters:
>- HEAD
>- SEC
>- DIR
>- Calendar
>- Dy
>- Mo
>- Yr
>
>We can conclude what some of these parameters are
>(such as: Dy = Day ; Mo = Month ; Yr = Year) and guess
>at some others (such as: Calendar = 1 therefore the
>next 3 parameters are Dy, Mo and Yr). But unless it's
>documented somewhere, there's no real way of knowing
>except through trial and error.
>And as a lot of sites aren't particularly happy with
>people extracting and repackaging the content of their
>site, they quite happily change their own systems on a
>regular basis.
>
>Hope this helped nonetheless,
>
>Jan Schenkel.
>
>"As we grow older, we grow both wiser and more foolish
>at the same time."  (De Rochefoucald)
>
>--- Bryan McCormick <brymac at i-2000.com> wrote:
> > OK folks, this one is beyond my skills. How do I get
> > Rev to send this URL
> > properly to get the page back? I suspect it involves
> > sending custom headers
> > and such, but how do I know how the CGI expects the
> > information?
> >
> >
>http://www.cboe.com/Common/PageViewer.asp?HEAD=Market+Statistics+Summary&SEC=3&DIR=TTMDMarketStat&Calendar=1&Dy=26&Mo=9&Yr=2002
> >
> > Help much appreciated.
>
>__________________________________________________
>Do you Yahoo!?
>New DSL Internet Access from SBC & Yahoo!
>http://sbc.yahoo.com
>_______________________________________________
>use-revolution mailing list
>use-revolution at lists.runrev.com
>http://lists.runrev.com/mailman/listinfo/use-revolution