Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pool connection not freed when response code is 307 (with example! 🎉 ) #717

Open
marcinkoziej opened this issue Mar 29, 2023 · 1 comment
Assignees

Comments

@marcinkoziej
Copy link

marcinkoziej commented Mar 29, 2023

Hi!

I managed to track down a situation where hackney_pool fills up if the response to POST is 307. I started seeing this in some APIs (SalesForce).

Try this example:

Save file below as server.exs and run elixir server.exs. It will make a POST 51 times until the last ones timeouts when waiting for the pool.

Mix.install [
  :cowboy, :plug, :plug_cowboy, :hackney
]

import Logger

defmodule Serv do 
  import Plug.Conn 

  def init(o) do
    o
  end

  def call(conn, _o) do 
    conn
    |> put_resp_content_type("text/plain")
    |> put_resp_header("Location", "/some")
    |> send_resp(307, "OK")

  end
end

{:ok, pid} = Plug.Cowboy.http Serv, [], port: 5000

info("Started server #{inspect pid}")

Enum.each 1..51, fn _ -> 
  {:ok, 307, _, _} = :hackney.request(:post, "http://localhost:5000", [], "", [pool: Pool])
  info inspect :hackney_pool.get_stats Pool 
end

What I am seeing is:

$ elixir -v
Erlang/OTP 25 [erts-13.1.4] [source] [64-bit] [smp:16:16] [ds:16:16:10] [async-threads:1] [jit:ns]
Elixir 1.14.3 (compiled with Erlang/OTP 23)

$ elixir server.exs
14:01:12.211 [info] Started server #PID<0.293.0>
14:01:12.242 [info] [name: Pool, max: 50, in_use_count: 1, free_count: 0, queue_count: 0]
14:01:12.242 [info] [name: Pool, max: 50, in_use_count: 2, free_count: 0, queue_count: 0]
(.......)
14:01:12.265 [info] [name: Pool, max: 50, in_use_count: 49, free_count: 0, queue_count: 0]
14:01:12.266 [info] [name: Pool, max: 50, in_use_count: 50, free_count: 0, queue_count: 0]


** (MatchError) no match of right hand side value: {:error, :checkout_timeout}
    server.exs:28: anonymous fn/1 in :elixir_compiler_0.__FILE__/1
    (elixir 1.14.3) lib/enum.ex:980: anonymous fn/3 in Enum.each/2
    (elixir 1.14.3) lib/enum.ex:4299: Enum.reduce_range/5
    (elixir 1.14.3) lib/enum.ex:2472: Enum.each/2

Hope this helps tracking down these pesky connection pool bugs!

@marcinkoziej marcinkoziej changed the title Pool connection not freed when response code is 307 Pool connection not freed when response code is 307 (with example! :tada) Mar 29, 2023
@marcinkoziej marcinkoziej changed the title Pool connection not freed when response code is 307 (with example! :tada) Pool connection not freed when response code is 307 (with example! 🎉 ) Mar 29, 2023
@benoitc benoitc self-assigned this Apr 3, 2023
@felipe-lopez-solaris
Copy link

+1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants