profile
viewpoint

Ask questionsTest failed with error `too many open files`

Bug Report

What version of TiKV are you using? <!-- You can run tikv-server --version -->

3.0.0-beta.1

What operating system and CPU are you using? <!-- You can run cat /proc/cpuinfo -->

macOS 10.14.4

What did you do? <!-- If possible, provide a recipe for reproducing the error. A complete runnable program is good. -->

cargo test or make dev

What did you expect to see?

The tests are passed.

What did you see instead?

This is the last part of output:

test cases::test_coprocessor::test_readpool_full ... ok
test cases::test_coprocessor::test_snapshot_failed ... ok
test cases::test_coprocessor::test_snapshot_failed_2 ... ok
test cases::test_merge::test_node_merge_multiple_snapshots_not_together ... ok
test cases::test_merge::test_node_merge_multiple_snapshots_together ... ok
test cases::test_merge::test_node_merge_recover_snapshot ... ok
test cases::test_merge::test_node_merge_restart ... ok
test cases::test_merge::test_node_merge_rollback ... ok
test cases::test_pending_peers::test_pending_peers ... ok
E0502 11:28:39.529770000 123145708810240 wakeup_fd_pipe.cc:40]         pipe creation failed (24): Too many open files
E0502 11:28:39.529845000 123145708810240 ev_poll_posix.cc:981]         pollset_work: {"created":"@1556821719.529822000","description":"OS Error","errno":24,"file":"/Users/cowsay/.cargo/registry/src/github.com-1ecc6299db9ec823/grpcio-sys-0.4.2/grpc/src/core/lib/iomgr/wakeup_fd_pipe.cc","file_line":41,"os_error":"Too many open files","syscall":"pipe"}
E0502 11:28:39.529860000 123145708810240 completion_queue.cc:1045]     Completion queue next failed: {"created":"@1556821719.529822000","description":"OS Error","errno":24,"file":"/Users/cowsay/.cargo/registry/src/github.com-1ecc6299db9ec823/grpcio-sys-0.4.2/grpc/src/core/lib/iomgr/wakeup_fd_pipe.cc","file_line":41,"os_error":"Too many open files","syscall":"pipe"}
E0502 11:28:39.529881000 123145708810240 wakeup_fd_pipe.cc:40]         pipe creation failed (24): Too many open files
E0502 11:28:39.529907000 123145708810240 ev_poll_posix.cc:981]         pollset_work: {"created":"@1556821719.529889000","description":"OS Error","errno":24,"file":"/Users/cowsay/.cargo/registry/src/github.com-1ecc6299db9ec823/grpcio-sys-0.4.2/grpc/src/core/lib/iomgr/wakeup_fd_pipe.cc","file_line":41,"os_error":"Too many open files","syscall":"pipe"}
E0502 11:28:39.529941000 123145708810240 completion_queue.cc:1045]     Completion queue next failed: {"created":"@1556821719.529889000","description":"OS Error","errno":24,"file":"/Users/cowsay/.cargo/registry/src/github.com-1ecc6299db9ec823/grpcio-sys-0.4.2/grpc/src/core/lib/iomgr/wakeup_fd_pipe.cc","file_line":41,"os_error":"Too many open files","syscall":"pipe"}
E0502 11:28:39.529969000 123145708810240 wakeup_fd_pipe.cc:40]         pipe creation failed (24): Too many open files
E0502 11:28:39.529997000 123145708810240 ev_poll_posix.cc:981]         pollset_work: {"created":"@1556821719.529978000","description":"OS Error","errno":24,"file":"/Users/cowsay/.cargo/registry/src/github.com-1ecc6299db9ec823/grpcio-sys-0.4.2/grpc/src/core/lib/iomgr/wakeup_fd_pipe.cc","file_line":41,"os_error":"Too many open files","syscall":"pipe"}
E0502 11:28:39.530008000 123145708810240 completion_queue.cc:1045]     Completion queue next failed: {"created":"@1556821719.529978000","description":"OS Error","errno":24,"file":"/Users/cowsay/.cargo/registry/src/github.com-1ecc6299db9ec823/grpcio-sys-0.4.2/grpc/src/core/lib/iomgr/wakeup_fd_pipe.cc","file_line":41,"os_error":"Too many open files","syscall":"pipe"}
E0502 11:28:39.530147000 123145708810240 wakeup_fd_pipe.cc:40]         pipe creation failed (24): Too many open files
E0502 11:28:39.530168000 123145708810240 ev_poll_posix.cc:981]         pollset_work: {"created":"@1556821719.530155000","description":"OS Error","errno":24,"file":"/Users/cowsay/.cargo/registry/src/github.com-1ecc6299db9ec823/grpcio-sys-0.4.2/grpc/src/core/lib/iomgr/wakeup_fd_pipe.cc","file_line":41,"os_error":"Too many open files","syscall":"pipe"}
E0502 11:28:39.530175000 123145708810240 completion_queue.cc:1045]     Completion queue next failed: {"created":"@1556821719.530155000","description":"OS Error","errno":24,"file":"/Users/cowsay/.cargo/registry/src/github.com-1ecc6299db9ec823/grpcio-sys-0.4.2/grpc/src/core/lib/iomgr/wakeup_fd_pipe.cc","file_line":41,"os_error":"Too many open files","syscall":"pipe"}
E0502 11:28:39.530191000 123145708810240 wakeup_fd_pipe.cc:40]         pipe creation failed (24): Too many open files
E0502 11:28:39.530216000 123145708810240 ev_poll_posix.cc:981]         pollset_work: {"created":"@1556821719.530199000","description":"OS Error","errno":24,"file":"/Users/cowsay/.cargo/registry/src/github.com-1ecc6299db9ec823/grpcio-sys-0.4.2/grpc/src/core/lib/iomgr/wakeup_fd_pipe.cc","file_line":41,"os_error":"Too many open files","syscall":"pipe"}
E0502 11:28:39.530225000 123145708810240 completion_queue.cc:1045]     Completion queue next failed: {"created":"@1556821719.530199000","description":"OS Error","errno":24,"file":"/Users/cowsay/.cargo/registry/src/github.com-1ecc6299db9ec823/grpcio-sys-0.4.2/grpc/src/core/lib/iomgr/wakeup_fd_pipe.cc","file_line":41,"os_error":"Too many open files","syscall":"pipe"}
E0502 11:28:39.530241000 123145708810240 wakeup_fd_pipe.cc:40]         pipe creation failed (24): Too many open files
E0502 11:28:39.530267000 123145708810240 ev_poll_posix.cc:981]         pollset_work: {"created":"@1556821719.530249000","description":"OS Error","errno":24,"file":"/Users/cowsay/.cargo/registry/src/github.com-1ecc6299db9ec823/grpcio-sys-0.4.2/grpc/src/core/lib/iomgr/wakeup_fd_pipe.cc","file_line":41,"os_error":"Too many open files","syscall":"pipe"}
E0502 11:28:39.530355000 123145708810240 completion_queue.cc:1045]     Completion queue next failed: {"created":"@1556821719.530249000","description":"OS Error","errno":24,"file":"/Users/cowsay/.cargo/registry/src/github.com-1ecc6299db9ec823/grpcio-sys-0.4.2/grpc/src/core/lib/iomgr/wakeup_fd_pipe.cc","file_line":41,"os_error":"Too many open files","syscall":"pipe"}
...
E0502 11:28:51.848465000 123145717248000 wakeup_fd_pipe.cc:40]         pipe creation failed (24): Too many open files
E0502 11:28:51.848509000 123145717248000 ev_poll_posix.cc:981]         pollset_work: {"created":"@1556821731.848479000","description":"OS Error","errno":24,"file":"/Users/cowsay/.cargo/registry/src/github.com-1ecc6299db9ec823/grpcio-sys-0.4.2/grpc/src/core/lib/iomgr/wakeup_fd_pipe.cc","file_line":41,"os_error":"Too many open files","syscall":"pipe"}
E0502 11:28:51.848545000 123145717248000 completion_queue.cc:1045]     Completion queue next failed: {"created":"@1556821731.848479000","description":"OS Error","errno":24,"file":"/Users/cowsay/.cargo/registry/src/github.com-1ecc6299db9ec823/grpcio-sys-0.4.2/grpc/src/core/lib/iomgr/wakeup_fd_pipe.cc","file_line":41,"os_error":"Too many open files","syscall":"pipe"}
E0502 11:28:51.848574000 123145717248000 wakeup_fd_pipe.cc:40]         pipe creation failed (24): Too many open files
E0502 11:28:51.848615000 123145717248000 ev_poll_posix.cc:981]         pollset_work: {"created":"@1556821731.848589000","description":"OS Error","errno":24,"file":"/Users/cowsay/.cargo/registry/src/github.com-1ecc6299db9ec823/grpcio-sys-0.4.2/grpc/src/core/lib/iomgr/wakeup_fd_pipe.cc","file_line":41,"os_error":"Too many open files","syscall":"pipe"}
E0502 11:28:51.848686000 123145717248000 completion_queue.cc:1045]     Completion queue next failed: {"created":"@1556821731.848589000","description":"OS Error","errno":24,"file":"/Users/cowsay/.cargo/registry/src/github.com-1ecc6299db9ec823/grpcio-sys-0.4.2/grpc/src/core/lib/iomgr/wakeup_fd_pipe.cc","file_line":41,"os_error":"Too many open files","syscall":"pipe"}
thread panicked while panicking. aborting.
error: process didn't exit successfully: `/Users/cowsay/Projects/tikv/target/debug/deps/failpoints-1e9278adbf817cc4` (signal: 4, SIGILL: illegal instruction)

The omitted part is about thousands of lines.

tikv/tikv

Answer questions whoiscc

Sorry for late responding. The test is passed after setting. Now make dev executes with no error. Thank you!

useful!

Related questions

combine all binaries into one hot 1
PCP: test hot 1
Deploy tidb with docker swarm, fail to send snap between tikv of different hosts hot 1
Fix design of engine_traits for mutual associated types / type bound equality hot 1
Needs protoc dependency hot 1
Failpoint tests will not run when make dev hot 1
Running cargo bench causes panic hot 1
Better memory observation for tidb_query executors hot 1
how to disable gRPC batch mechanism hot 1
Github User Rank List