`stratis-min pool start` fails with EBADF about stratisd HOT 5 CLOSED

I don't think this needs anything special to reproduce. Any encrypted pool with a passphrase should exhibit this behavior. I found it when stratis-min failed like this during boot when called from stratis-fstab-setup.

from stratisd.

I could also reproduce this after boot, by stopping stratisd.service and then running stratisd-min and stratis-min from the command line.

from stratisd.

Smoking gun has got to be here:

+++ b/src/jsonrpc/client/key.rs
@@ -25,7 +25,7 @@ pub fn key_set(key_desc: KeyDescription, keyfile_path: Option<
&str>) -> StratisR
 
             let (read_end, write_end) = pipe()?;
             write(write_end, password.as_bytes())?;
-            do_request!(KeySet, key_desc; read_end)
+            do_request!(KeySet, key_desc; read_end.as_raw_fd())
         }
     };
     if rc != 0 {

and here:

--- a/src/jsonrpc/client/pool.rs
+++ b/src/jsonrpc/client/pool.rs
@@ -2,7 +2,7 @@
 // License, v. 2.0. If a copy of the MPL was not distributed with this
 // file, You can obtain one at http://mozilla.org/MPL/2.0/.
 
-use std::path::PathBuf;
+use std::{os::fd::AsRawFd, path::PathBuf};
 
 use nix::unistd::{pipe, write};
 
@@ -37,7 +37,7 @@ pub fn pool_start(
         do_request_standard!(PoolStart, id, unlock_method; {
             let (read_end, write_end) = pipe()?;
             write(write_end, password.as_bytes())?;
-            read_end
+            read_end.as_raw_fd()
         })
     } else {
         do_request_standard!(PoolStart, id, unlock_method)

Actually, I believe the first change is benign because the pipe is created before the macro is expanded.

from stratisd.

-            do_request!(KeySet, key_desc; read_end)
+            do_request!(KeySet, key_desc; read_end.as_raw_fd())

Just thinking out loud, I have no idea what's actually going on: Does this now leak the file descriptor? I.e., where is it closed now? But maybe this doesn't matter in a one-shot process like stratis-min. It will exit very soon anyway.

from stratisd.

-            do_request!(KeySet, key_desc; read_end)
+            do_request!(KeySet, key_desc; read_end.as_raw_fd())

Just thinking out loud, I have no idea what's actually going on: Does this now leak the file descriptor? I.e., where is it closed now? But maybe this doesn't matter in a one-shot process like stratis-min. It will exit very soon anyway.

The do_request_standard! macros final "argument" is the entire expression below.

let (read_end, write_end) = pipe()?;
             write(write_end, password.as_bytes())?;
            read_end

When the macro is expanded, that whole bit of syntax is evaluated and used in the call. That worked, when read_end was the value of the expression, because Rust lifetime rules prevented drop from being called on the file descriptor while it was in use. But when nix went to requiring a raw file descriptor instead, i.e., just a number, the lifetime rules allowed the file to be dropped while that number was still in use.

from stratisd.