26 replies

1. daniel roe 🇺🇦 13 min later

   @zachleat @nhoizey 👀

2. Shawn Holmes 27 min later

   @zachleat @nhoizey 404?

   1. Nicolas Hoizey 1 hr later

      @Hanzo55 the repository is currently private, we'll open it ASAP

      @zachleat

3. Nicolas Hoizey 1 hr later

   @zachleat awesome, thanks! 🙏

   1. Zach Leatherman 1 hr later

      @nhoizey The code is in _pretty_ good shape, it’s maybe a quick review away from publishing! README should have some very terse steps to get going

      1. Zach Leatherman 2 hr later

         @nhoizey one more wishlist thing I’d love to see is another repo where people can add their own canonical twitter archive URLs that we can publish and use to federate links! Like, if I say @zachleat maps to zachleat.com/twitter then the archive can automatically map tweet URLs to those new domains

         1. Nicolas Hoizey 2 hr later

            @zachleat great idea! 👍
            Do you want to open an issue for this, or should I do it and mention your toot?

            1. Zach Leatherman 3 hr later

               @nhoizey https://github.com/tweetback/tweetback-canonical/issues/1

      2. Nicolas Hoizey 2 hr later

         @zachleat I'm currently running it on my backup. More than 30 minutes already, is the first build supposed to take longer than next builds?

         1. Zach Leatherman 2 hr later

            @nhoizey if it’s taking forever I’d try replacing the eleventyImg local media caching with just a straight passthrough to the image sources (just for testing)

            https://github.com/tweetback/tweetback/blob/1393a01aa292b62ce348dd5e7f042653b6e355e2/src/twitter.js#LL5C7-L5C18

            1. Nicolas Hoizey 2 hr later

               @zachleat the build just finished!

               1. Nicolas Hoizey 2 hr later

                  @zachleat I think it took a long time because it had to get almost 6000 images from Twitter API

                  1. Zach Leatherman 2 hr later

                     @nhoizey awesome!

                     1. Zach Leatherman 2 hr later

                        @nhoizey repeats should be much faster with the local cache folder

                        1. Nicolas Hoizey 2 hr later

                           @zachleat indeed! 🎉

                           > Wrote 55477 files in 24.98 seconds

                           🤯

                           1. Nicolas Hoizey 2 hr later

                              @zachleat but I know I have more than 100.000 tweets, so should I be worried with "only" 55477 files written?

                              1. Nicolas Hoizey 3 hr later

                                 @zachleat looks like my Twitter archive only contains 55469 tweets, so maybe when Twitter says I have 118,5 k Tweets, there are many RTs also counted. 🤷‍♂️

                                 1. Zach Leatherman 3 hr later

                                    @nhoizey hmmmmm, I believe retweets are included in the archive

                     2. Nicolas Hoizey 2 hr later

                        @zachleat are images binaries also in the `.cache` folder?

                        1. Zach Leatherman 3 hr later

                           @nhoizey yeah so if you clear your _site folder it should still be fast. I think it might be better to have those images in source control though, not sure why I chose to write them to _site

                           1. Nicolas Hoizey 3 hr later

                              @zachleat it takes only 90 seconds after removing the `_site` folder, really great! 👍

                              It's almost 2em here, I'll continue tomorrow… 😅

                              1. Zach Leatherman 3 hr later

                                 @nhoizey ack! Go to bed!!

                                 1. Nicolas Hoizey 3 hr later

                                    @zachleat 😁💤

                                    1. Zach Leatherman 3 hr later

                                       @nhoizey when you wake up—just fyi I made a few more changes and merged to main

                                       https://github.com/tweetback/tweetback

                                       Namely that images are now written to `/img/` so that CI builds don’t have to fetch them the first time 🏆

                                       1. Steren 4 hr later

                                          @zachleat @nhoizey can't wait for the repo to be public. I'll be the first to give it a try!

                                       2. Bramus 14 hr later

                                          @zachleat @nhoizey 👀