lain/twitter-scrapper
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
254 commits 1 branch 0 tags 447 KiB
Commit graph

254 commits

This branch
This branch
All branches
Author SHA1 Message Date
Valentine
d45ac95957 Merge pull request #1 from imperatrona/open-account 
Reusing open account
 2024-01-28 23:39:48 +03:00
Valentine
9987e7b8be update readme 2024-01-28 23:35:18 +03:00
Valentine
8dda773032 update package name 2024-01-28 23:06:45 +03:00
Nomadic
fdd172a136 Merge pull request #152 from laikee99/Auth-for-SetProxy 
Update scraper.go
 2023-11-05 00:39:41 +02:00
Laike Du
1f4290bd5c Update scraper.go 
Support auth for SetProxy socks5
 2023-11-04 15:57:15 +08:00
Nomadic
e63ee5fdc2 Merge pull request #147 from n0madic/dependabot/go_modules/golang.org/x/net-0.17.0 
Bump golang.org/x/net from 0.11.0 to 0.17.0
 2023-10-12 13:49:31 +03:00
dependabot[bot]
c0e067d55e Bump golang.org/x/net from 0.11.0 to 0.17.0 
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.11.0 to 0.17.0.
- [Commits](https://github.com/golang/net/compare/v0.11.0...v0.17.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-10-11 22:49:30 +00:00
Thalles
ad4df95c0d feat: allow to use specific open account 2023-10-08 22:01:10 -03:00
Thalles
c8ad9a0410 feat: return open account 2023-10-08 21:58:48 -03:00
Alexander Sheiko
87180a4cfc Fix OpenAccount error handling 2023-09-16 11:49:07 +03:00
Nomadic
f19d249077 Fix typo 2023-07-12 00:30:08 +03:00
Alexander Sheiko
53d4add980 GetTrends required login 2023-07-07 13:20:05 +03:00
Alexander Sheiko
41b7e80ee8 Improve skip auth test 2023-07-07 13:19:37 +03:00
Nomadic
7393ab5136 Merge pull request #117 from berkaltiok/patch-1 
Create clear cookies function
 2023-07-06 15:50:00 +03:00
Nomadic
828e106659 Merge pull request #118 from coolestowl/patch-login-deny 
update auth.go , getFlowToken handle DenyLoginSubtask
 2023-07-06 15:48:38 +03:00
coolestowl
e11917de18 Update auth.go 2023-07-06 13:24:39 +08:00
Berk Altıok
24c31ac232 feat: add clear cookies function 2023-07-05 22:20:56 +03:00
Alexander Sheiko
0ba238e6a1 Remove env from CI 2023-07-03 15:16:47 +03:00
Alexander Sheiko
4b12db0e74 Update deps 2023-07-03 15:14:02 +03:00
Alexander Sheiko
563bd85080 Running only some tests in CI 2023-07-03 15:12:50 +03:00
Alexander Sheiko
5f380af184 Use global test scraper with auth 2023-07-03 15:06:56 +03:00
Alexander Sheiko
d34f982b0d Update README 2023-07-03 15:05:36 +03:00
Alexander Sheiko
e1f3f48ae9 Fix runtime error 2023-07-03 14:57:29 +03:00
Alexander Sheiko
391e443058 Use search GraphQL API 
Close #109 #116
 2023-07-03 14:38:46 +03:00
Alexander Sheiko
07ad3789ef Authentication is required! 
(quick dirty fix)
Close #115
 2023-07-02 01:41:48 +03:00
Nomadic
5b0c8c3f9f Merge pull request #112 from helios2003/master 
Fixed typo in README in the section "Search profiles by query".
 2023-06-25 23:50:53 +03:00
Ankit Dash
5032d6517d Update README.md 2023-06-26 02:13:01 +05:30
Nomadic
2c19aab28b Merge pull request #110 from Veetaha/feat/get-tweet-gifs 
Parse GIFs for in the GetTweet API
 2023-06-20 10:47:53 +03:00
Veetaha
9c3764f484 Parse GIFs for in the GetTweet API 
I am writing an app that needs to get info about all media in a tweet and forward it to a Telegram chat.

Today animated GIFs are ignored in the response of TweetDetail, although the are there (exept for the caveat mentioned below). So without this change the GIFs are not present in the twitterscraper.Tweet struct.

Following the analogy with the split between Photos and Videos I added GIFs to the Tweet type.

There is one caveat that I found during testing that I can't really explain. But GIFs don't occur in the response unless the bearerToken2 is set. I don't know what this token means, maybe it somehow identifies a destop-browser variant of twitter frontend, but with this token the GIFs are present in the response.

Please note that I never wrote Go code before in my life. I am using this library via the FFI to link it to my Rust codebase.
 2023-06-18 19:35:34 +02:00
Alexander Sheiko
15e5f233b7 Support 2FA 
Close #106
 2023-06-12 18:23:26 +03:00
Alexander Sheiko
d9d8ee67b6 Support for threaded tweets 
Close #84
 2023-06-05 13:49:56 +03:00
Alexander Sheiko
0f96589c74 Remove skip pinned tweet 
Close #103
 2023-06-04 13:12:21 +03:00
Alexander Sheiko
50440667ed Use GraphQL API with timeline v2 
Close #85
Close #82
Close #77
Close #76
 2023-06-01 23:20:11 +03:00
Alexander Sheiko
c07bd1d1d4 improve request 2023-06-01 23:05:37 +03:00
Alexander Sheiko
e52022e31a Add LoginOpenAccount 
Close #101 again
 2023-05-30 17:31:00 +03:00
Alexander Sheiko
16e8b34638 Fix trends 2023-05-30 17:14:38 +03:00
Alexander Sheiko
10887ac302 Skip test with authentication 2023-05-21 01:29:08 +03:00
Nomadic
0c2489c695 Merge pull request #99 from regynald/master 
Add view count to tweets
 2023-05-21 01:14:33 +03:00
Nomadic
b2a9b3c722 Update search example 
Close #100
 2023-05-21 01:10:22 +03:00
Regynald Augustin
45d30f7304 Add test 2023-05-18 15:51:03 -04:00
Regynald Augustin
b458d2bd82 Add views to timeline and parse 2023-05-18 15:18:29 -04:00
Regynald Augustin
048fce5cf2 Add views to tweet type 2023-05-18 15:18:17 -04:00
Alexander Sheiko
66780eb801 Remove deprecated functions 
Removed global default scraper
 2023-05-11 14:15:56 +03:00
Alexander Sheiko
3eb86161ce Fix 403 error 2023-05-11 13:36:32 +03:00
Alexander Sheiko
848bdfd3cf Bump go version to 1.16 2023-05-10 22:29:40 +03:00
Alexander Sheiko
90f9a71721 Improve logout 
drop session in Twitter
 2023-05-10 22:24:32 +03:00
Alexander Sheiko
e86c2fa4ce Improve login flow 
support LoginAcid task
 2023-05-10 21:48:41 +03:00
Alexander Sheiko
3bb78070b7 Add creds for CI 2023-05-10 17:43:02 +03:00
Nomadic
cd3e612419 Merge pull request #95 from windowsdeveloperwannabe/tweets-by-id 
Fetch tweets by userID
 2023-05-10 17:13:12 +03:00
Nomadic
7c78ad7719 Merge pull request #92 from windowsdeveloperwannabe/user-name 
Add user's full name to tweet
 2023-05-10 17:11:31 +03:00