29954b8b57
Summary: Not a CMake expert, and the current CMake build support added by this PR is unlikely the best way of doing it. Sending out the PR to demonstrate it can work. Pull Request resolved: https://github.com/facebook/rocksdb/pull/9214 Test Plan: Will need to update https://github.com/ajkr/dedupfs with CMake build. Also, PR https://github.com/facebook/rocksdb/issues/9170 and PR https://github.com/facebook/rocksdb/issues/9206 both include CMake support for their plugins, and can be used as a proof of concept. Reviewed By: ajkr Differential Revision: D32738273 Pulled By: riversand963 fbshipit-source-id: da87fb4377c716bbbd577a69763b48d22483f845
3.2 KiB
Building external plugins together with RocksDB
RocksDB offers several plugin interfaces for developers to customize its behavior. One difficulty developers face is how to make their plugin available to end users. The approach discussed here involves building the external code together with the RocksDB code into a single binary. Note another approach we plan to support involves loading plugins dynamically from shared libraries.
Discovery
We hope developers will mention their work in "PLUGINS.md" so users can easily discover and reuse solutions for customizing RocksDB.
Directory organization
External plugins will be linked according to their name into a subdirectory of "plugin/". For example, a plugin called "dedupfs" would be linked into "plugin/dedupfs/".
Build standard
Currently the only supported build system are make and cmake.
For make, files in the plugin directory ending in the .mk extension can define the following variables.
$(PLUGIN_NAME)_SOURCES: these files will be compiled and linked with RocksDB. They can access RocksDB public header files.$(PLUGIN_NAME)_HEADERS: these files will be installed in the RocksDB header directory. Their paths will be prefixed by "rocksdb/plugin/$(PLUGIN_NAME)/".$(PLUGIN_NAME)_LDFLAGS: these flags will be passed to the final link step. For example, library dependencies can be propagated here, or symbols can be forcibly included, e.g., for static registration.$(PLUGIN_NAME)_CXXFLAGS: these flags will be passed to the compiler. For example, they can specify locations of header files in non-standard locations.
Users will run the usual make commands from the RocksDB directory, specifying the plugins to include in a space-separated list in the variable ROCKSDB_PLUGINS.
For CMake, the CMakeLists.txt file in the plugin directory can define the following variables.
${PLUGIN_NAME}_SOURCES: these files will be compiled and linked with RocksDB. They can access RocksDB public header files.${PLUGIN_NAME}_COMPILE_FLAGS: these flags will be passed to the compiler. For example, they can specify locations of header files in non-standard locations.${PLUGIN_NAME}_INCLUDE_PATHS: paths to directories to search for plugin-specific header files during compilation.${PLUGIN_NAME}_LIBS: list of library names required to build the plugin, e.g.dl,java,jvm,rados, etc. CMake will generate proper flags for linking.${PLUGIN_NAME}_LINK_PATHS: list of paths for the linker to search for required libraries in additional to standard locations.${PLUGIN_NAME}_CMAKE_SHARED_LINKER_FLAGSadditional linker flags used to generate shared libraries. For example, symbols can be forcibly included, e.g., for static registration.${PLUGIN_NAME}_CMAKE_EXE_LINKER_FLAGS: additional linker flags used to generate executables. For example, symbols can be forcibly included, e.g., for static registration.
Users will run the usual cmake commands, specifying the plugins to include in a space-separated list in the command line variable ROCKSDB_PLUGINS when invoking cmake.
cmake .. -DROCKSDB_PLUGINS="dedupfs hdfs rados"
Example
For a working example, see Dedupfs.