Editing Rook Storage for Kubernetes (section)

==== External cluster instructions -- DEPRECATED, but retained for historical (hysterical) reasons in case Rook gets their act straight ====

Though not absolutely required, it is recommended to use a separate namespace for the external cluster.  The default scripts and manifests assume you will do this, so it is easier to just go with the flow ... the namespace in the provided manifests is 'rook-ceph-external'.  As with the rook operator, support roles, role bindings, and such need to be created along with the actual separate namespace:

 kubectl create -f common-external.yaml

The Rook Cluster definition needs authentication and identification data about the external cluster; this is loaded into kubernetes secrets with standard names so that the operator and storage provisioner can access the external ceph cluster.  The data can be obtained from the ceph master node:
* Cluster FSID -- run this command and copy the results:
 ceph fsid
* Cluster Monitor address -- located in the /etc/ceph/ceph.conf file
* Cluster admin secret -- located in the /etc/ceph/ceph.client.admin.keyring

For convenience, the set of commends has been copied to a script in the k8s-admin repository; multiple copies exist for the 'prod', 'dev' and 'test' clusters.  

Put the information into environment variables at the top of the script as shown below, then run the script to create the secrets:
 export NAMESPACE=rook-ceph-external
 export ROOK_EXTERNAL_FSID=dc852252-bd6b-11ea-b7f2-503eaa02062c
 export ROOK_EXTERNAL_CEPH_MON_DATA=storage1=10.1.0.9:6789
 export ROOK_EXTERNAL_ADMIN_SECRET=AQAclf9e0ptoMBAAracpRwXomJ6LgiO6L8wqfw==
 bash ./import-external-cluster.sh

Note that the above script adds too many secrets -- the operator tries to create them again when building the cluster interface -- and errors out since they can't be changed.  We need to either edit the script to not create the excess secrets or delete the ones that aren't needed.  For now, we will delete them.  First find all the ones that are present in the new namespace:
 kubectl get secret -n rook-ceph-external

These are the ones that need to be deleted (at least for now):
 kubectl -n rook-ceph-external delete secret \
    rook-csi-cephfs-node rook-csi-cephfs-provisioner rook-csi-rbd-node rook-csi-rbd-provisioner

Watch the operator log as you create the cluster below to see if any additional secrets need to be deleted.  Now we can create the cluster definition that the operator will use to create our interface:

 kubectl create -f cluster-external-management.yaml