andreacavalli/rocksdb
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

Increase soft open file limit for mini-crashtest on Linux (#9972)

Browse Source 
Summary:
CircleCI was using a soft open file limit of 1024 which would
frequently be exceeded during test runs. Now using
```
ulimit -S -n `ulimit -H -n`
```
to set soft limit up to the hard limit (524288 in my test). I've also
applied this same idiom to existing applicable MacOS configurations to
reduce hard-coding numbers.

Pull Request resolved: https://github.com/facebook/rocksdb/pull/9972

Test Plan: CI

Reviewed By: riversand963

Differential Revision: D36262943

Pulled By: pdillinger

fbshipit-source-id: 86320cdf9b68a97fdb73531a7b4a59b4c2d2f73f
This commit is contained in:
Peter Dillinger 2022-05-10 09:51:03 -07:00 committed by Facebook GitHub Bot
parent 7b7a37c069
commit e78451f3f6
1 changed files with 5 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

10
.circleci/config.yml
View File

@ -182,7 +182,7 @@ jobs:
- increase-max-open-files-on-macos - increase-max-open-files-on-macos
- install-gflags-on-macos - install-gflags-on-macos
- pre-steps-macos - pre-steps-macos
- run: ulimit -S -n 1048576 && OPT=-DCIRCLECI make V=1 J=32 -j32 all - run: ulimit -S -n `ulimit -H -n` && OPT=-DCIRCLECI make V=1 J=32 -j32 all
- post-steps - post-steps
build-macos-cmake: build-macos-cmake:
@ -201,7 +201,7 @@ jobs:
- pre-steps-macos - pre-steps-macos
- run: - run:
name: "cmake generate project file" name: "cmake generate project file"
command: ulimit -S -n 1048576 && mkdir build && cd build && cmake -DWITH_GFLAGS=1 .. command: ulimit -S -n `ulimit -H -n` && mkdir build && cd build && cmake -DWITH_GFLAGS=1 ..
- run: - run:
name: "Build tests" name: "Build tests"
command: cd build && make V=1 -j32 command: cd build && make V=1 -j32
@ -210,14 +210,14 @@ jobs:
steps: steps:
- run: - run:
name: "Run even tests" name: "Run even tests"
command: ulimit -S -n 1048576 && cd build && ctest -j32 -I 0,,2 command: ulimit -S -n `ulimit -H -n` && cd build && ctest -j32 -I 0,,2
- when: - when:
condition: condition:
not: << parameters.run_even_tests >> not: << parameters.run_even_tests >>
steps: steps:
- run: - run:
name: "Run odd tests" name: "Run odd tests"
command: ulimit -S -n 1048576 && cd build && ctest -j32 -I 1,,2 command: ulimit -S -n `ulimit -H -n` && cd build && ctest -j32 -I 1,,2
- post-steps - post-steps
build-linux: build-linux:
@ -506,7 +506,7 @@ jobs:
- pre-steps - pre-steps
- install-gflags - install-gflags
- install-compression-libs - install-compression-libs
- run: make V=1 -j8 CRASH_TEST_EXT_ARGS=--duration=960 blackbox_crash_test_with_atomic_flush - run: ulimit -S -n `ulimit -H -n` && make V=1 -j8 CRASH_TEST_EXT_ARGS=--duration=960 blackbox_crash_test_with_atomic_flush
- post-steps - post-steps
build-windows: build-windows: