Skip to content
0
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo

fedi wiki

  1. Home
  2. Bug Reports
  3. NodeBB 4.13: activitypub/fetchPublicKey Rate limit exceeded errors.

NodeBB 4.13: activitypub/fetchPublicKey Rate limit exceeded errors.

Scheduled Pinned Locked Moved Bug Reports
17 Posts 3 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • K kichae@community.nodebb.org

    Starting with 4.13, I've started receiving rate limit errors for ActivityPub public key fetching attempts. As a result, my World feed has drawn to a crawl and I am receiving almost no content from Lemmy servers or larger Mastodon instances.

    [4566/1203025] - warn: [activitypub/fetchPublicKey] Rate limit exceeded for IP [IP ADDRESS 1]
    [4566/1203025] - warn: [activitypub/fetchPublicKey] Rate limit exceeded for IP [IP ADDRESS 2]
    [4566/1203025] - warn: [activitypub/fetchPublicKey] Rate limit exceeded for IP [IP ADDRESS 3]
    [4566/1203025] - warn: [activitypub/fetchPublicKey] Rate limit exceeded for IP [IP ADDRESS 4]
    [4566/1203025] - warn: [activitypub/fetchPublicKey] Rate limit exceeded for IP [IP ADDRESS 5]
    

    (IP addresses removed manually)

    K This user is from outside of this forum
    K This user is from outside of this forum
    kichae@community.nodebb.org
    wrote last edited by
    #8

    I had to push the value up to 240 to make the errors stop totally. I haven't noticed any meaningful difference in my World feed after doing this, but my error log's much cleaner now.

    I'm still not seeing movement on the Lemmy side of things. I went to check the Lemmy forums I'm subscribed to here, to see if there's a similar issue there, and... it's been 18 days since the last Lemmy post was received by com.nbb from the communities I'm subscribed to. These might be separate issues...

    julian@community.nodebb.orgJ 2 Replies Last reply
    0
    • K kichae@community.nodebb.org

      I had to push the value up to 240 to make the errors stop totally. I haven't noticed any meaningful difference in my World feed after doing this, but my error log's much cleaner now.

      I'm still not seeing movement on the Lemmy side of things. I went to check the Lemmy forums I'm subscribed to here, to see if there's a similar issue there, and... it's been 18 days since the last Lemmy post was received by com.nbb from the communities I'm subscribed to. These might be separate issues...

      julian@community.nodebb.orgJ This user is from outside of this forum
      julian@community.nodebb.orgJ This user is from outside of this forum
      julian@community.nodebb.org
      wrote last edited by
      #9

      @Kichae understood, I'll have to take a closer look.

      There is definitely an issue, some relays have stopped working but I'm sure the relay is fine.

      Stay tuned...

      1 Reply Last reply
      0
      • K kichae@community.nodebb.org

        I had to push the value up to 240 to make the errors stop totally. I haven't noticed any meaningful difference in my World feed after doing this, but my error log's much cleaner now.

        I'm still not seeing movement on the Lemmy side of things. I went to check the Lemmy forums I'm subscribed to here, to see if there's a similar issue there, and... it's been 18 days since the last Lemmy post was received by com.nbb from the communities I'm subscribed to. These might be separate issues...

        julian@community.nodebb.orgJ This user is from outside of this forum
        julian@community.nodebb.orgJ This user is from outside of this forum
        julian@community.nodebb.org
        wrote last edited by
        #10

        @Kichae there's definitely a federation issue with Lemmy here...

        This dashboard shows ActivityPub.Space is just over three weeks behind lemmy.world. Failure count is ~64, which means Lemmy stopped sending stuff over.

        I upped my public key fetch limiter value to 512 as well, and will see if this addresses the issue.

        julian@activitypub.spaceJ 1 Reply Last reply
        0
        • julian@community.nodebb.orgJ julian@community.nodebb.org

          @Kichae there's definitely a federation issue with Lemmy here...

          This dashboard shows ActivityPub.Space is just over three weeks behind lemmy.world. Failure count is ~64, which means Lemmy stopped sending stuff over.

          I upped my public key fetch limiter value to 512 as well, and will see if this addresses the issue.

          julian@activitypub.spaceJ This user is from outside of this forum
          julian@activitypub.spaceJ This user is from outside of this forum
          julian@activitypub.space
          wrote last edited by julian@activitypub.space
          #11

          @kichae@community.nodebb.org can you try again with the latest develop commits?

          A couple things:

          • You can now set the rate limit value to 0 to disable it completely
          • The logic was a mix of both a db-backed mutex lock and a rate limiter, which was overkill. I think what happened was Lemmy (or other popular instances) sent many activities all at once, causing the rate-limiter to trip, even though the value was well under the threshold.

          The default is now updated to 256 but if you've overridden it your value stays. I'll keep an eye on Lemmy federation to see if that was the issue...

          If I am right, then within the next 6-24 hours, I should be receiving a flurry of Lemmy content as it speedruns through the backlog.

          1 Reply Last reply
          0
          • julian@community.nodebb.orgJ This user is from outside of this forum
            julian@community.nodebb.orgJ This user is from outside of this forum
            julian@community.nodebb.org
            wrote last edited by
            #12

            https://github.com/NodeBB/NodeBB/issues/14422 for updates.

            1 Reply Last reply
            0
            • julian@activitypub.spaceJ This user is from outside of this forum
              julian@activitypub.spaceJ This user is from outside of this forum
              julian@activitypub.space
              wrote last edited by
              #13

              As it turns out I was not right, at least not entirely <img class="not-responsive emoji" src="https://activitypub.space/assets/plugins/nodebb-plugin-emoji/emoji/android/1f61b.png?v=c1f554d6ce2" title="😛" />

              1 Reply Last reply
              0
              • K This user is from outside of this forum
                K This user is from outside of this forum
                kichae@community.nodebb.org
                wrote last edited by
                #14

                Yeah, I'm not seeing anything behaving differently on develop. My logs are super clean now, though.

                julian@activitypub.spaceJ 1 Reply Last reply
                0
                • K kichae@community.nodebb.org

                  Yeah, I'm not seeing anything behaving differently on develop. My logs are super clean now, though.

                  julian@activitypub.spaceJ This user is from outside of this forum
                  julian@activitypub.spaceJ This user is from outside of this forum
                  julian@activitypub.space
                  wrote last edited by
                  #15

                  @kichae@community.nodebb.org hopefully this will be something that we'll see results on within a day.

                  Once Lemmy decides your server is "down", it won't send anything for awhile. How long that is I don't know offhand.

                  1 Reply Last reply
                  0
                  • julian@activitypub.spaceJ This user is from outside of this forum
                    julian@activitypub.spaceJ This user is from outside of this forum
                    julian@activitypub.space
                    wrote last edited by julian@activitypub.space
                    #16

                    @kichae@community.nodebb.org

                    Heckin' yeah. Update to the latest develop again.

                    b7b1568d-c326-4f53-b290-575909a003ab-image.jpeg

                    0e1dffa8-ce84-42c8-ada6-7ce23e8bd9ce-image.jpeg

                    For me, lemmy.world hasn't started re-sending activities yet, but it will... 👀 There it goes... 5 million activities an hour hahah

                    1 Reply Last reply
                    0
                    • julian@activitypub.spaceJ This user is from outside of this forum
                      julian@activitypub.spaceJ This user is from outside of this forum
                      julian@activitypub.space
                      wrote last edited by
                      #17

                      Better, but it's not over yet:

                      71b3e327-73fb-4635-aef1-45c7aa71b02a-image.jpeg

                      Error rates have crept back up, so there's more debugging to do.

                      1 Reply Last reply
                      0

                      Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                      Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                      With your input, this post could be even better 💗

                      Register Login
                      Reply
                      • Reply as topic
                      Log in to reply
                      • Oldest to Newest
                      • Newest to Oldest
                      • Most Votes


                      • Login

                      • Don't have an account? Register

                      • Login or register to search.
                      Powered by NodeBB Contributors
                      • First post
                        Last post