Running out of memory when installing deps

[activecollection]

I'm using Livebook v0.17.3 in a docker container with available 4 GB of memory. When installing dependencies, the process is getting killed by the system. Is there any way of limiting the needed memory, the number of parallel processes during Mix.install?

[josevalim]

Not really. Compilation is a memory intensive process and, depending on what you are compiling, it will use GBs, especially if it has native dependencies in C and Rust. If you are using Docker to build apps, you can use a build image to warm up the apps by installing their dependencies, so you use less memory at runtime, but if you are just using Livebook as a playground, then there aren't any options at the moment. What are your dependencies and how many cores have you listed in your container?

[activecollection]

4 cores

I'm trying to install httpoison.

Mix.install([
  {:httpoison, "~> 2.2"}
])

The log I get from dmesg:

[351210.885789] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=user.slice,mems_allowed=0,global_oom,task_memcg=/system.slice/docker-de6f62d9d1f523be17ec629f11a0f9337e8a772bbb7f3ac6e5266089d8996b15.scope,task=beam.smp,pid=251334,uid=0
[351210.885832] Out of memory: Killed process 251334 (beam.smp) total-vm:4809044kB, anon-rss:2189296kB, file-rss:0kB, shmem-rss:24268kB, UID:0 pgtables:4596kB oom_score_adj:0

[josevalim]

Interesting. That in itself should not use that much memory. Which Elixir version are you using?

[activecollection]

Elixir 1.18.3 (compiled with Erlang/OTP 27)

as shipped in the docker image: ghcr.io/livebook-dev/livebook