lain/twitter-scrapper
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
367 commits 1 branch 0 tags 447 KiB
Commit graph

367 commits

This branch
This branch
All branches
Author SHA1 Message Date
Valentine
4907a49780 add user media 2024-02-20 23:42:41 +03:00
Valentine
2de3793bce fix socks proxy without auth 2024-02-20 23:42:41 +03:00
Valentine
d9641755d1 Merge pull request #2 from imperatrona/new-tests 
Update tests
 2024-02-20 23:37:23 +03:00
Valentine
cc633cb1ea fix tests 2024-02-20 23:27:22 +03:00
Valentine
6a5df36aed add authtoken auth 2024-02-20 21:43:19 +03:00
Valentine
8d81775809 add auth with token 2024-02-20 17:26:54 +03:00
Joaco Esteban
bd65223b41 Add Sensitive field to Profile struct 2024-02-14 12:27:29 +01:00
Valentine
19b6e56438 add user media 2024-02-13 04:45:08 +03:00
Joaco Esteban
a1511c3869 Remove maxFollowingNbr parameter from FetchFollowingByUserID function 2024-02-03 15:34:03 +01:00
Joaco Esteban
985351070d rename 2024-02-03 14:56:01 +01:00
Joaco Esteban
c967fdefdd FEAT, list following 2024-02-03 14:53:11 +01:00
Joaco Esteban
be3eeb9091 Add tmp to .gitignore 2024-02-03 14:52:47 +01:00
Valentine
dbe17fb4d0 fix socks proxy without auth 2024-01-29 00:07:40 +03:00
Valentine
d45ac95957 Merge pull request #1 from imperatrona/open-account 
Reusing open account
 2024-01-28 23:39:48 +03:00
Valentine
9987e7b8be update readme 2024-01-28 23:35:18 +03:00
Valentine
8dda773032 update package name 2024-01-28 23:06:45 +03:00
Nomadic
fdd172a136 Merge pull request #152 from laikee99/Auth-for-SetProxy 
Update scraper.go
 2023-11-05 00:39:41 +02:00
Laike Du
1f4290bd5c Update scraper.go 
Support auth for SetProxy socks5
 2023-11-04 15:57:15 +08:00
Nomadic
e63ee5fdc2 Merge pull request #147 from n0madic/dependabot/go_modules/golang.org/x/net-0.17.0 
Bump golang.org/x/net from 0.11.0 to 0.17.0
 2023-10-12 13:49:31 +03:00
dependabot[bot]
c0e067d55e Bump golang.org/x/net from 0.11.0 to 0.17.0 
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.11.0 to 0.17.0.
- [Commits](https://github.com/golang/net/compare/v0.11.0...v0.17.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-10-11 22:49:30 +00:00
Thalles
ad4df95c0d feat: allow to use specific open account 2023-10-08 22:01:10 -03:00
Thalles
c8ad9a0410 feat: return open account 2023-10-08 21:58:48 -03:00
Alexander Sheiko
87180a4cfc Fix OpenAccount error handling 2023-09-16 11:49:07 +03:00
Nomadic
f19d249077 Fix typo 2023-07-12 00:30:08 +03:00
Alexander Sheiko
53d4add980 GetTrends required login 2023-07-07 13:20:05 +03:00
Alexander Sheiko
41b7e80ee8 Improve skip auth test 2023-07-07 13:19:37 +03:00
Nomadic
7393ab5136 Merge pull request #117 from berkaltiok/patch-1 
Create clear cookies function
 2023-07-06 15:50:00 +03:00
Nomadic
828e106659 Merge pull request #118 from coolestowl/patch-login-deny 
update auth.go , getFlowToken handle DenyLoginSubtask
 2023-07-06 15:48:38 +03:00
coolestowl
e11917de18 Update auth.go 2023-07-06 13:24:39 +08:00
Berk Altıok
24c31ac232 feat: add clear cookies function 2023-07-05 22:20:56 +03:00
Alexander Sheiko
0ba238e6a1 Remove env from CI 2023-07-03 15:16:47 +03:00
Alexander Sheiko
4b12db0e74 Update deps 2023-07-03 15:14:02 +03:00
Alexander Sheiko
563bd85080 Running only some tests in CI 2023-07-03 15:12:50 +03:00
Alexander Sheiko
5f380af184 Use global test scraper with auth 2023-07-03 15:06:56 +03:00
Alexander Sheiko
d34f982b0d Update README 2023-07-03 15:05:36 +03:00
Alexander Sheiko
e1f3f48ae9 Fix runtime error 2023-07-03 14:57:29 +03:00
Alexander Sheiko
391e443058 Use search GraphQL API 
Close #109 #116
 2023-07-03 14:38:46 +03:00
Alexander Sheiko
07ad3789ef Authentication is required! 
(quick dirty fix)
Close #115
 2023-07-02 01:41:48 +03:00
Nomadic
5b0c8c3f9f Merge pull request #112 from helios2003/master 
Fixed typo in README in the section "Search profiles by query".
 2023-06-25 23:50:53 +03:00
Ankit Dash
5032d6517d Update README.md 2023-06-26 02:13:01 +05:30
Nomadic
2c19aab28b Merge pull request #110 from Veetaha/feat/get-tweet-gifs 
Parse GIFs for in the GetTweet API
 2023-06-20 10:47:53 +03:00
Veetaha
9c3764f484 Parse GIFs for in the GetTweet API 
I am writing an app that needs to get info about all media in a tweet and forward it to a Telegram chat.

Today animated GIFs are ignored in the response of TweetDetail, although the are there (exept for the caveat mentioned below). So without this change the GIFs are not present in the twitterscraper.Tweet struct.

Following the analogy with the split between Photos and Videos I added GIFs to the Tweet type.

There is one caveat that I found during testing that I can't really explain. But GIFs don't occur in the response unless the bearerToken2 is set. I don't know what this token means, maybe it somehow identifies a destop-browser variant of twitter frontend, but with this token the GIFs are present in the response.

Please note that I never wrote Go code before in my life. I am using this library via the FFI to link it to my Rust codebase.
 2023-06-18 19:35:34 +02:00
Alexander Sheiko
15e5f233b7 Support 2FA 
Close #106
 2023-06-12 18:23:26 +03:00
Alexander Sheiko
d9d8ee67b6 Support for threaded tweets 
Close #84
 2023-06-05 13:49:56 +03:00
Alexander Sheiko
0f96589c74 Remove skip pinned tweet 
Close #103
 2023-06-04 13:12:21 +03:00
Alexander Sheiko
50440667ed Use GraphQL API with timeline v2 
Close #85
Close #82
Close #77
Close #76
 2023-06-01 23:20:11 +03:00
Alexander Sheiko
c07bd1d1d4 improve request 2023-06-01 23:05:37 +03:00
Alexander Sheiko
e52022e31a Add LoginOpenAccount 
Close #101 again
 2023-05-30 17:31:00 +03:00
Alexander Sheiko
16e8b34638 Fix trends 2023-05-30 17:14:38 +03:00
Alexander Sheiko
10887ac302 Skip test with authentication 2023-05-21 01:29:08 +03:00