Comments (16)
polastre
commented on August 21, 2024
1
If you want to try a new approach, check out the puppeteer branch that is a work in progress. It will be much slower, and likely less reliable, but at least is working most of the time at the moment.
You'll need to run node united2.js instead of united.js. Be sure to run npm install before trying to run it.
Let me know what kind of problems you run into, please post in this issue.
Proposed changes: https://github.com/polastre/united/tree/puppeteer
from united.
polastre
commented on August 21, 2024
1
I've merged puppeteer branch into master and created a new release.
I've parallelized the requests, so it is much faster. Increased the timeout for people on slower connections.
Feel free to open new issues regarding the new approach.
from united.
polastre
commented on August 21, 2024
It isn't surprising. It is a bit of a cat and mouse game.
It wouldn't be hard to ping their site, get a cookie, and insert it into the headers for the request here: https://github.com/polastre/united/blob/master/united.js#L95
Feel free to submit a PR/patch.
from united.
cedricyau
commented on August 21, 2024
It appears to be a little more involved than a basic access cookie. Seems that the cookies are tied to the individual request parameters and represent a hash. The second half of the _abck cookie in particular changes based on the request parameters (eg origin, destination, travel date). Attribute-Based Canetti-Krawczyk appears to be what that represents.
from united.
ctkelley
commented on August 21, 2024
npm install failed for me
I've attached the log file. I tried both versions with the same results
2017-11-27T10_18_22_541Z-debug.log
2017-11-27T10_18_22_541Z-debug.log
from united.
polastre
commented on August 21, 2024
The first 5 lines of your log tell you to upgrade node and npm
…On Mon, Nov 27, 2017 at 2:22 AM ctkelley ***@***.***> wrote:
npm install failed for me
I've attached the log file. I tried both versions with the same results
2017-11-27T10_18_22_541Z-debug.log
<https://github.com/polastre/united/files/1505440/2017-11-27T10_18_22_541Z-debug.log>
2017-11-27T10_18_22_541Z-debug.log
<https://github.com/polastre/united/files/1505444/2017-11-27T10_18_22_541Z-debug.log>
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<#7 (comment)>, or mute
the thread
<https://github.com/notifications/unsubscribe-auth/ACbAMrKriuzfV5Dj7v072Vlx6XkDNXHOks5s6o1bgaJpZM4QeVgD>
.
from united.
ctkelley
commented on August 21, 2024
I did that using the link you had. It seemed to work. What could have gone
wrong?
C. T. Kelley
Mathematics Department
NCSU
[email protected]
from united.
polastre
commented on August 21, 2024
@ctkelley Download the latest node. Here's what your log says:
0 info it worked if it ends with ok
1 warn npm npm does not support Node.js v5.0.0
2 warn npm You should probably upgrade to a newer version of node as we
3 warn npm can't make any promises that npm will work with this version.
4 warn npm Supported releases of Node.js are the latest release of 4, 6, 7, 8.
5 warn npm You can find the latest version at https://nodejs.org/
Please follow the instructions
from united.
polastre
commented on August 21, 2024
You will need at least Node 7, likely Node 8.
from united.
ctkelley
commented on August 21, 2024
I was at that link and got node 9. After that failed I tried node 8 with
the same result.
C. T. Kelley
Mathematics Department
NCSU
[email protected]
On Nov 27, 2017, at 11:54 AM, Joe Polastre <[email protected]> wrote:
You will need *at least* Node 7, likely Node 8.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#7 (comment)>, or mute
the thread
<https://github.com/notifications/unsubscribe-auth/AJxL-zj4NV3TTWWKVYQwF8c72ThAIHh9ks5s6uk5gaJpZM4QeVgD>
.
from united.
polastre
commented on August 21, 2024
According to your log, npm is not up to date. This is not the forum for
technical support on your dev environment. I recommend you use a tool like
Hoembrew or Macports on a mac to maintain your environment.
…On Mon, Nov 27, 2017 at 8:57 AM ctkelley ***@***.***> wrote:
I was at that link and got node 9. After that failed I tried node 8 with
the same result.
C. T. Kelley
Mathematics Department
NCSU
***@***.***
On Nov 27, 2017, at 11:54 AM, Joe Polastre ***@***.***>
wrote:
You will need *at least* Node 7, likely Node 8.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#7 (comment)>, or
mute
the thread
<
https://github.com/notifications/unsubscribe-auth/AJxL-zj4NV3TTWWKVYQwF8c72ThAIHh9ks5s6uk5gaJpZM4QeVgD
>
.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<#7 (comment)>, or mute
the thread
<https://github.com/notifications/unsubscribe-auth/ACbAMvybvEb9_EPVwQbgjkv9jBxDR8Utks5s6unlgaJpZM4QeVgD>
.
from united.
cedricyau
commented on August 21, 2024
Clever! I figured (Headless) Chrome might be needed but I wasn't sure how to do that in NodeJS.
from united.
ctkelley
commented on August 21, 2024
I’m in over my head on this. Thanks anyway.
On Mon, Nov 27, 2017 at 11:58 AM, Joe Polastre <[email protected]>
wrote:
… According to your log, npm is not up to date. This is not the forum for
technical support on your dev environment. I recommend you use a tool like
Hoembrew or Macports on a mac to maintain your environment.
On Mon, Nov 27, 2017 at 8:57 AM ctkelley ***@***.***> wrote:
> I was at that link and got node 9. After that failed I tried node 8 with
> the same result.
>
> C. T. Kelley
> Mathematics Department
> NCSU
> ***@***.***
>
> On Nov 27, 2017, at 11:54 AM, Joe Polastre ***@***.***>
> wrote:
>
> You will need *at least* Node 7, likely Node 8.
>
> —
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on GitHub
> <#7 (comment)>, or
> mute
> the thread
> <
> https://github.com/notifications/unsubscribe-auth/AJxL-
zj4NV3TTWWKVYQwF8c72ThAIHh9ks5s6uk5gaJpZM4QeVgD
> >
> .
>
> —
> You are receiving this because you commented.
>
>
> Reply to this email directly, view it on GitHub
> <#7 (comment)>,
or mute
> the thread
> <https://github.com/notifications/unsubscribe-auth/ACbAMvybvEb9_
EPVwQbgjkv9jBxDR8Utks5s6unlgaJpZM4QeVgD>
> .
>
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#7 (comment)>, or mute
the thread
<https://github.com/notifications/unsubscribe-auth/AJxL-14mDyktRd-Z1RMHEWpOYi1Pu4dJks5s6uo6gaJpZM4QeVgD>
.
--
C. T. Kelley
Department of Mathematics, Box 8205
SAS Hall
2311 Stinson Drive
North Carolina State University
Raleigh, NC 27695-8205
(919) 515-7163, (919) 513-7336 (FAX)
[email protected]
http://www.math.ncsu.edu/~ctk/
from united.
ctkelley
commented on August 21, 2024
It works with no timeout about 50% of the time. That’s progress. Thanks for
the fast work on this.
…On Mon, Nov 27, 2017 at 3:20 PM, C. T. Kelley ***@***.***> wrote:
Found an old copy of node. The npm install works. I’m getting timeouts
from the app, which I guess is no surprise.
On Mon, Nov 27, 2017 at 3:03 PM, C. T. Kelley ***@***.***> wrote:
> I’m in over my head on this. Thanks anyway.
>
> On Mon, Nov 27, 2017 at 11:58 AM, Joe Polastre ***@***.***>
> wrote:
>
>> According to your log, npm is not up to date. This is not the forum for
>> technical support on your dev environment. I recommend you use a tool
>> like
>> Hoembrew or Macports on a mac to maintain your environment.
>>
>> On Mon, Nov 27, 2017 at 8:57 AM ctkelley ***@***.***>
>> wrote:
>>
>> > I was at that link and got node 9. After that failed I tried node 8
>> with
>> > the same result.
>> >
>> > C. T. Kelley
>> > Mathematics Department
>> > NCSU
>> > ***@***.***
>> >
>> > On Nov 27, 2017, at 11:54 AM, Joe Polastre ***@***.***>
>> > wrote:
>> >
>> > You will need *at least* Node 7, likely Node 8.
>> >
>> > —
>> > You are receiving this because you were mentioned.
>> > Reply to this email directly, view it on GitHub
>> > <#7 (comment)>,
>> or
>> > mute
>> > the thread
>> > <
>> > https://github.com/notifications/unsubscribe-auth/AJxL-zj4NV
>> 3TTWWKVYQwF8c72ThAIHh9ks5s6uk5gaJpZM4QeVgD
>> > >
>> > .
>> >
>> > —
>> > You are receiving this because you commented.
>> >
>> >
>> > Reply to this email directly, view it on GitHub
>> > <#7 (comment)>,
>> or mute
>> > the thread
>> > <https://github.com/notifications/unsubscribe-auth/ACbAMvybv
>> Eb9_EPVwQbgjkv9jBxDR8Utks5s6unlgaJpZM4QeVgD>
>>
>> > .
>> >
>>
>> —
>> You are receiving this because you were mentioned.
>> Reply to this email directly, view it on GitHub
>> <#7 (comment)>,
>> or mute the thread
>> <https://github.com/notifications/unsubscribe-auth/AJxL-14mDyktRd-Z1RMHEWpOYi1Pu4dJks5s6uo6gaJpZM4QeVgD>
>> .
>>
>
>
>
> --
> C. T. Kelley
> Department of Mathematics, Box 8205
> SAS Hall
> 2311 Stinson Drive
> North Carolina State University
> Raleigh, NC 27695-8205
> (919) 515-7163, (919) 513-7336 (FAX)
> ***@***.***
> http://www.math.ncsu.edu/~ctk/
>
--
C. T. Kelley
Department of Mathematics, Box 8205
SAS Hall
2311 Stinson Drive
North Carolina State University
Raleigh, NC 27695-8205
(919) 515-7163, (919) 513-7336 (FAX)
***@***.***
http://www.math.ncsu.edu/~ctk/
--
C. T. Kelley
Department of Mathematics, Box 8205
SAS Hall
2311 Stinson Drive
North Carolina State University
Raleigh, NC 27695-8205
(919) 515-7163, (919) 513-7336 (FAX)
[email protected]
http://www.math.ncsu.edu/~ctk/
from united.
ctkelley
commented on August 21, 2024
Found an old copy of node. The npm install works. I’m getting timeouts from
the app, which I guess is no surprise.
…On Mon, Nov 27, 2017 at 3:03 PM, C. T. Kelley ***@***.***> wrote:
I’m in over my head on this. Thanks anyway.
On Mon, Nov 27, 2017 at 11:58 AM, Joe Polastre ***@***.***>
wrote:
> According to your log, npm is not up to date. This is not the forum for
> technical support on your dev environment. I recommend you use a tool like
> Hoembrew or Macports on a mac to maintain your environment.
>
> On Mon, Nov 27, 2017 at 8:57 AM ctkelley ***@***.***>
> wrote:
>
> > I was at that link and got node 9. After that failed I tried node 8 with
> > the same result.
> >
> > C. T. Kelley
> > Mathematics Department
> > NCSU
> > ***@***.***
> >
> > On Nov 27, 2017, at 11:54 AM, Joe Polastre ***@***.***>
> > wrote:
> >
> > You will need *at least* Node 7, likely Node 8.
> >
> > —
> > You are receiving this because you were mentioned.
> > Reply to this email directly, view it on GitHub
> > <#7 (comment)>,
> or
> > mute
> > the thread
> > <
> > https://github.com/notifications/unsubscribe-auth/AJxL-zj4NV
> 3TTWWKVYQwF8c72ThAIHh9ks5s6uk5gaJpZM4QeVgD
> > >
> > .
> >
> > —
> > You are receiving this because you commented.
> >
> >
> > Reply to this email directly, view it on GitHub
> > <#7 (comment)>,
> or mute
> > the thread
> > <https://github.com/notifications/unsubscribe-auth/
> ACbAMvybvEb9_EPVwQbgjkv9jBxDR8Utks5s6unlgaJpZM4QeVgD>
>
> > .
> >
>
> —
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on GitHub
> <#7 (comment)>, or mute
> the thread
> <https://github.com/notifications/unsubscribe-auth/AJxL-14mDyktRd-Z1RMHEWpOYi1Pu4dJks5s6uo6gaJpZM4QeVgD>
> .
>
--
C. T. Kelley
Department of Mathematics, Box 8205
SAS Hall
2311 Stinson Drive
North Carolina State University
Raleigh, NC 27695-8205
(919) 515-7163, (919) 513-7336 (FAX)
***@***.***
http://www.math.ncsu.edu/~ctk/
--
C. T. Kelley
Department of Mathematics, Box 8205
SAS Hall
2311 Stinson Drive
North Carolina State University
Raleigh, NC 27695-8205
(919) 515-7163, (919) 513-7336 (FAX)
[email protected]
http://www.math.ncsu.edu/~ctk/
from united.
kirtan
commented on August 21, 2024
@polastre just tried puppeteer branch and it worked well for a simple request, but still getting TIMEOUT! error sometimes.
from united.
Related Issues (17)
- Error after first iteration HOT 1
- "Cannot read property 'Trips'..." HOT 1
- [MS WINDOWS] Unable to run using newest version HOT 2
- Error: Cannot find module "puppeteer" HOT 2
- Can code be modified for Global Services Members? HOT 1
- how do I make a search and get the ticket price in points HOT 1
- Dockerize application for more availability
- Can't edit search parameters HOT 2
- seems not to work properly anymore HOT 3
- [Feature Request] Filter Upgrade Type Premium Economy / Business HOT 1
- New united.com flight search breaks united.js
- Still working?
- Only one date is returned HOT 3
- False Positives
- Problems on high Sierra HOT 5
- Access denied HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from united.