lain/twitter-scrapper
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
301 commits 1 branch 0 tags 447 KiB
Commit graph

40 commits

Author SHA1 Message Date
Denis Koltsov
5e1d9316e7
Initial stub at GetHomeTweets 2024-04-07 19:18:59 +02:00
Valentine
02625a94bd updated GetTweet anon endpoint 2024-03-08 18:43:26 +03:00
Alexander Sheiko
07ad3789ef Authentication is required! 
(quick dirty fix)
Close #115
 2023-07-02 01:41:48 +03:00
Veetaha
9c3764f484 Parse GIFs for in the GetTweet API 
I am writing an app that needs to get info about all media in a tweet and forward it to a Telegram chat.

Today animated GIFs are ignored in the response of TweetDetail, although the are there (exept for the caveat mentioned below). So without this change the GIFs are not present in the twitterscraper.Tweet struct.

Following the analogy with the split between Photos and Videos I added GIFs to the Tweet type.

There is one caveat that I found during testing that I can't really explain. But GIFs don't occur in the response unless the bearerToken2 is set. I don't know what this token means, maybe it somehow identifies a destop-browser variant of twitter frontend, but with this token the GIFs are present in the response.

Please note that I never wrote Go code before in my life. I am using this library via the FFI to link it to my Rust codebase.
 2023-06-18 19:35:34 +02:00
Alexander Sheiko
50440667ed Use GraphQL API with timeline v2 
Close #85
Close #82
Close #77
Close #76
 2023-06-01 23:20:11 +03:00
Alexander Sheiko
e52022e31a Add LoginOpenAccount 
Close #101 again
 2023-05-30 17:31:00 +03:00
Alexander Sheiko
66780eb801 Remove deprecated functions 
Removed global default scraper
 2023-05-11 14:15:56 +03:00
windowsdeveloperwannabe
76b2215e59 add fetch tweets by userID func 2023-05-10 06:09:11 -07:00
Alexander Sheiko
bfb4020597 Deprecate default scraper 2022-05-04 11:55:12 +03:00
Alexander Sheiko
34aae0d008 Extend timeline object 2021-07-16 11:08:43 +03:00
Alexander Sheiko
5032ecd29d Add SearchProfiles 
Minor changes and fixes
 2021-04-22 21:38:49 +03:00
Alexander Sheiko
da34364bf9 Add GetTweet for default Scraper 2021-03-09 11:02:39 +02:00
Alexander Sheiko
a8089a552e Add GetTweet 2021-03-09 10:40:22 +02:00
Alexander Sheiko
6bf65cd482 Add Scraper object 2020-12-12 23:33:57 +02:00
Alexander Sheiko
edad8f6393 Total refactoring 
Used guest frontend API
BREAKING CHANGE: remove tweet.HTML property
Loading more information
Minor fixes and changes
 2020-12-11 20:58:49 +02:00
Alexander Sheiko
ce79652ff5 Use name=orig for photos 2020-10-12 09:49:56 +03:00
Dmitry Khalansky
648743f47f Fix image grids not being recognized as photos 2020-10-11 23:15:51 +03:00
Alexander Sheiko
6d0779c4a9 Fix links 2020-09-19 11:54:52 +03:00
Alexander Sheiko
ae913c7d88 Fix photo 2020-09-19 11:30:05 +03:00
Alexander Sheiko
7c415c4373 Fix photo 2020-09-19 01:15:08 +03:00
Alexander Sheiko
69c8b035ea Quick dirty fix GetTweets 2020-09-19 00:57:03 +03:00
Alexander Sheiko
2fbd561ceb Quick dirty fix tweets (use search) 2020-08-13 17:41:24 +03:00
Alexander Sheiko
f99c2aaa1f Add user info in tweet 2020-06-15 16:38:51 +03:00
Alexander Sheiko
49baceb5b4 Getting tweets by the maximum number, not by pages as before 
BREAKING CHANGE!
 2020-06-15 16:16:08 +03:00
Alexander Sheiko
c12927172f Add newRequest function with common headers 2020-06-15 11:59:30 +03:00
mind1949
5048018d48 use Context to send cancelation signals to groutines 2020-06-12 21:31:08 +08:00
Nomadic
bf3225765d Merge pull request #6 from xiscocapllonch/master 
New feature for search queries
 2020-05-15 19:17:22 +03:00
Alexander Sheiko
a34a14d25a Fix some golangci-lint warnings 
Minor changes
 2020-05-14 21:52:55 +03:00
xisco
37bb62a82a create readTweetsFromHtml func for recycle code 2020-05-13 17:35:44 +02:00
xisco
a033bfafa1 add Accept-Language header en-Us 2020-04-22 20:55:27 +02:00
tolantop
e64c140c20 selector change 2020-03-04 22:10:11 +03:00
tolantop
fcb4411c18 Merge remote-tracking branch 'master/master' into pr/1 
# Conflicts:
#	go.mod
 2020-03-04 11:19:13 +03:00
tolantop
c5cffefae1 add: detect pin post 2020-03-04 01:53:13 +03:00
Alexander Sheiko
ca155dc018 minor fix 2020-02-14 16:21:20 +02:00
Alexander Sheiko
cea7f72d9d Add Trends 2020-02-12 10:45:19 +02:00
Alexander Sheiko
eb1636da25 Fix IsRetweet 2020-02-11 17:32:05 +02:00
Alexander Sheiko
f8d05eb115 Fix video links 2020-02-11 16:56:00 +02:00
Alexander Sheiko
70ededdd53 Change error message 2019-09-16 11:57:41 +03:00
Nomadic
1faa46f8d1 Return result with error 2019-09-15 10:56:58 +03:00
Nomadic
5d2fb52297 Some changes 2019-09-13 22:38:05 +03:00
Renamed from twitter-scraper.go (Browse further)