How to gracefully remove host from NSX-T based Supervisor Cluster?

Recently got this question couple of times on how to gracefully remove host from existing Supervisor cluster, which is configured with NSX-T. I thought it is worth to write a quick post with detailed steps. Removal of the host from existing Supervisor cluster can be for multiple reasons, it can be for some maintenance or adding host into other supervisor cluster etc.

If you are still not aware of what is this Supervisor cluster, I would highly recommend you read this blog post.

Below steps are written assuming you have NSX-T based Supervisor cluster configured. In NSX-T based supervisor cluster, ESXi hosts are also working as kubernetes worker nodes, hence it is important they are properly removed from cluster. In new 70 U1 capability vSphere with Tanzu with vSphere (VDS) networking, ESXi hosts are no more worker nodes as there it is all about Tanzu kubernetes clusters (aka Guest clusters), hence removing host from VDS based Supervisor cluster is same as earlier.

Steps :

  1. Identify the host you would like to remove.
  2. Put the host in maintenance mode
  3. Since host is now going into maintenance mode, all the vSphere pods running on this node/host will be re-created on the other available hosts (DRS will take care of recommending proper host).
  4. VMs running on this host such as Supervisor control plane VMs or Guest Cluster VMs or any other normal VMs will be migrated to other available hosts as usual.
  5. Once host goes into maintenance mode, spherelet service on the host will be stopped but spherelet vib pushed to ESXi host will be still there. you can check spherelet vib and service status using below commands. SSH to host for running below commands.
  6. “esxcli software vib list | grep spherelet” & “/etc/init.d/spherelet status”
  7. When host goes into maintenance mode, in kubernetes term, it is called node is drained. i.e. this host is no more ready for taking any k8s workloads. When you run “kubectl get nodes”, it should be shown as “not ready”.
  8. NSX-T host transport node will be still as it is in configured state. You can confirm it from NSX-T UI or you can also check “nsx” vibs on host in maintenance mode.
  9. Now instead of removing this directly from inventory, move this host as standalone host into datacenter.
  10. As soon as you move this host as standalone host, spherelet vib on the host will be removed as well i.e. no spherelet service will be on it as well.
  11. Also, NSX-T host transport node will be un-configured as well automatically. i.e. All NSX-T vibs are removed at this stage. You can check it from NSX-T UI, it should be shown as “Not Configured”. This happens because while configuring NSX-T, we had applied host transport node profile on vSphere cluster level.
  12. “kubectl get nodes” or H5C UI (Cluster >> Monitor >> Namespaces >> Overview) should not show this host as worker node.
  13. Only reference now pending is, this host is still part of Distributed switch (DVS/VDS) you configured as part of Supervisor Cluster. You can remove it from usual DVS UI workflow.
  14. At this stage, this host is completely free to go for maintenance or add into another Supervisor cluster. You can remove it now from vCenter server inventory as needed.
  15. To add host back into same Supervisor cluster again, it is better to have host in maintenance mode, make sure you add this host back to DVS/VDS configured. Move this host into cluster, exit from maintenance mode and it will automatically install spherelet and NSX-T vibs and after few min, it will be ready for taking k8s workloads.

Further reading:
1. vSphere with Kubernetes (now vSphere with Tanzu) 101 is here
2. Official documentation for vSphere with Kubernetes is here
3. Automation around Supervisor cluster
4. Read about new 70 U1 capability vSphere with Tanzu with vSphere (VDS) networking
5. Automating supervisor cluster workflows using Java

191 thoughts on “How to gracefully remove host from NSX-T based Supervisor Cluster?

  1. I have been exploring for a little bit for any high-quality articles or weblog posts in this
    kind of space . Exploring in Yahoo I eventually stumbled
    upon this site. Reading this information So i am glad
    to express that I have an incredibly just right uncanny
    feeling I discovered exactly what I needed. I such a lot indubitably will
    make sure to do not put out of your mind this web site and provides it a look on a continuing basis.

    my web site rollex11 id test

  2. I blog frequently and I genuinely appreciate your content.
    Your article has really peaked my interest. I will take a note of your blog and keep checking for new
    information about once a week. I subscribed to your RSS feed as well.

    Here is my blog pussy888 archer (918kiss-m.com)

  3. Saya telah telah berselancar online lebih dari 3 jam hari ini,
    namun saya tidak pernah menemukan artikel menarik
    seperti milik Anda. It’s cukup berharga bagi saya.
    Dalam pandangan saya, jika semua pemilik situs dan blogger membuat konten yang baik seperti yang Anda lakukan, net akan menjadi a jauh lebih
    berguna dari sebelumnya.

    Also visit my site; Joker123 apk net

  4. hello there and thank you for your information ? I have certainly picked up anything new from right here.

    I did however expertise a few technical points using this website, since I experienced to reload the website a lot of times previous to I could get it
    to load correctly. I had been wondering if your web host is
    OK? Not that I’m complaining, but sluggish loading instances times will often affect your placement in google and
    can damage your high-quality score if advertising and marketing with Adwords.
    Well I?m adding this RSS to my email and can look out for much more
    of your respective interesting content. Ensure that you update this again soon..

    Also visit my page – http://forum.nobletronics.com/index.php?action=profile;u=36814

  5. I’m now not certain the place you are getting your info, but good topic.
    I needs to spend some time learning more or understanding more.
    Thanks for wonderful info I used to be looking
    for this info for my mission.

    Have a look at my webpage Dominick

  6. While onsite SEO is important, your real email address particulars are going arrive from offsite SEO.
    Getting increased search engine traffic demands a lot of
    labor to be fully experienced.

  7. My partner and I stumbled over here coming from a different page and thought I might
    as well check things out. I like what I see so i am just following you.
    Look forward to going over your web page
    for a second time.

  8. Attractive portion of content. I just stumbled upon your web site and in accession capital to
    say that I acquire actually loved account your blog
    posts. Anyway I will be subscribing to your augment
    or even I fulfillment you get right of entry to consistently fast.

  9. Right here is the perfect web site for anybody who really
    wants to understand this topic. You realize a whole lot its almost hard to argue
    with you (not that I personally would want to?HaHa). You certainly put a new spin on a subject which has been discussed for many years.
    Excellent stuff, just wonderful!

    Take a look at my web-site; shltaxi.com

  10. Its such as you learn my mind! You seem to know a lot about this,
    like you wrote the book in it or something. I feel
    that you can do with a few percent to drive the message
    home a bit, but other than that, that is wonderful blog.
    An excellent read. I will certainly be back.

    Look at my web page: alichehade.net

  11. Thanks so much pertaining to giving me an update on this theme on your web-site.

    Please realize that if a brand new post appears or if perhaps any adjustments occur with the current post, I
    would want to consider reading a lot more and knowing how to make good utilization of those approaches you share.
    Thanks for your efforts and consideration of others by making your blog
    available.

    Take a look at my web page; bettyjostarke.net

  12. What i do not understood is actually how you are
    not really a lot more smartly-liked than you might be right now.
    You are so intelligent. You already know thus significantly when it comes to this subject, produced me in my
    view consider it from a lot of various angles. Its like women and men are not fascinated
    unless it is something to do with Lady gaga! Your personal stuffs
    outstanding. Always deal with it up!

    Here is my webpage http://forum.nobletronics.com/index.php?action=profile;u=69507

  13. Can I just say ᴡhat ɑ relief to uncoѵer somebody who actually knowѕ wnat they’re talking about
    ovеr the internet. You cеrtainly know how to ƅring an issսe to
    light and make іt important. A llot more people should
    read this and understand this sіde of the story. I can’t belueve you aren’t more popular since you most
    certainlly have the gift.

  14. obviously like your website however you need to check the spelling on several of
    your posts. A number of them are rife with spelling problems and I to find it very bothersome to inform the reality on the other hand I will surely
    come again again.

    Here is my web-site – next360.com

  15. Hello, I believe your web site may be having internet browser compatibility problems.
    Whenever I look at your site in Safari, it looks fine however when opening in Internet Explorer, it’s got some overlapping issues.

    I merely wanted to provide you with a quick heads up!
    Apart from that, wonderful site!

    Also visit my website: Latesha

  16. Thank you for sharing superb informations. Your site is very cool.
    I’m impressed by the details that you’ve on this web site.
    It reveals how nicely you understand this subject.
    Bookmarked this website page, will come back for extra articles.
    You, my friend, ROCK! I found just the info I already searched everywhere and just couldn’t come across.
    What an ideal web-site.

    Visit my web site :: ppo.energisehost.com

  17. You could definitely see your skills within the work you write.
    The arena hopes for more passionate writers such as
    you who aren’t afraid to mention how they believe. At all times follow your heart.

    Here is my web page … shaboxes.com

  18. Definitely believe that which you stated. Your favorite justification appeared to be on the internet the simplest thing to be aware of.
    I say to you, I certainly get annoyed while people consider worries
    that they plainly do not know about. You managed to hit the nail upon the top as well as defined
    out the whole thing without having side effect , people can take a signal.
    Will probably be back to get more. Thanks

    Feel free to surf to my webpage – http://forum.yawfle.com

  19. I’m really loving the theme/design of your weblog. Do you
    ever run into any internet browser compatibility problems?
    A few of my blog audience have complained about my website
    not working correctly in Explorer but looks great in Opera.
    Do you have any ideas to help fix this issue?

    my webpage :: payfirstsolutions.com

  20. Great beat ! I would like to apprentice whilst you amend your site, how can i subscribe for a blog website?
    The account helped me a appropriate deal. I have been tiny
    bit familiar of this your broadcast offered shiny clear concept.

    Here is my website … biomicrobics.com

  21. Good day! I could have sworn I’ve been to this blog before but after
    browsing through some of the post I realized it’s
    new to me. Anyhow, I’m definitely delighted I found it and I’ll
    be bookmarking and checking back frequently!

  22. hey there and thank you for your information ?
    I?ve certainly picked up anything new from right here. I did however expertise some technical points using
    this web site, as I experienced to reload the site many times
    previous to I could get it to load properly. I had been wondering if your hosting is OK?
    Not that I am complaining, but slow loading instances
    times will sometimes affect your placement in google and can damage your high-quality score if ads
    and marketing with Adwords. Anyway I?m adding this RSS to my email
    and can look out for a lot more of your respective interesting content.
    Ensure that you update this again very soon..

    my web-site … lasix3.us

  23. I’m very pleased to find this site. I want to to thank you
    for your time for this fantastic read!! I definitely appreciated every part of
    it and i also have you bookmarked to check out new stuff
    on your web site.

    Also visit my webpage :: vadatahub.org

  24. I just like the valuable information you provide in your articles.
    I’ll bookmark your weblog and test again here regularly.

    I’m somewhat certain I’ll learn many new stuff proper right here!
    Good luck for the following!

    My web page … Tim

  25. I just like the valuable information you provide to your articles.
    I’ll bookmark your weblog and check once more here regularly.
    I am reasonably sure I’ll learn many new stuff proper here!
    Best of luck for the following!

    Feel free to visit my web blog; forum.yawfle.com

  26. Hi, I think your site might be having browser compatibility issues.
    When I look at your blog site in Safari, it looks fine but
    when opening in Internet Explorer, it has some overlapping.

    I just wanted to give you a quick heads up! Other then that, amazing blog!

    Also visit my site biblioray.pusku.com

  27. I seldom leave a response, however I browsed a few responses on this page
    How to gracefully remove host from NSX-T based Supervisor Cluster?
    | vThinkBeyondVM. I actually do have a couple of questions for you if you do not mind.
    Is it simply me or does it look as if like a few
    of these comments come across like they are left by brain dead visitors?
    😛 And, if you are writing at other sites, I’d like to keep up with anything fresh you
    have to post. Would you post a list of the
    complete urls of all your public sites like your twitter feed, Facebook page or linkedin profile?

    Feel free to visit my website :: http://www.groovyfreeads.com/user/profile/425085

  28. What i do not realize is in fact how you are no longer
    actually a lot more neatly-appreciated than you may be right
    now. You’re so intelligent. You already know therefore significantly relating to this subject,
    produced me in my opinion believe it from numerous varied angles.
    Its like men and women are not involved unless it is
    one thing to do with Lady gaga! Your own stuffs outstanding.
    All the time take care of it up!

    my web site – http://www.interleads.net

  29. I tend not to leave a leave a response, but I browsed a few responses here
    How to gracefully remove host from NSX-T based Supervisor Cluster?

    | vThinkBeyondVM. I actually do have a few questions for you if it’s allright.
    Could it be just me or does it look as if like a few of
    the remarks look as if they are written by brain dead visitors?
    😛 And, if you are writing at additional online sites, I’d like to keep up
    with you. Would you list of every one of all your social community pages like your linkedin profile, Facebook page or twitter
    feed?

    Also visit my web site :: http://www.makemoneydonothing.com/

  30. I loved as much as you will receive carried out right here.

    The sketch is tasteful, your authored subject matter stylish.
    nonetheless, you command get bought an edginess over
    that you wish be delivering the following. unwell unquestionably come
    more formerly again since exactly the same nearly a lot often inside
    case you shield this increase.

    my page; http://www.avianoslist.com

  31. I have been exploring for a bit for any high quality articles
    or weblog posts in this kind of area . Exploring in Yahoo I finally stumbled
    upon this web site. Studying this info So i’m satisfied to
    express that I’ve a very good uncanny feeling I discovered exactly what I needed.
    I such a lot undoubtedly will make sure to do not
    forget this web site and give it a look regularly.

    Here is my webpage – Shayna

  32. I wanted to follow up and let you know how really I liked discovering your blog
    today. I would consider it an honor to work at
    my office and be able to make use of the tips shared
    on your blog and also engage in visitors’ opinions like this.
    Should a position connected with guest article author become available at your end,
    please let me know.

    my webpage :: ppo.energisehost.com

  33. Hi I am so delighted I found your website, I really found you by accident,
    while I was researching on Yahoo for something else, Nonetheless I am here now and would just like to
    say many thanks for a marvelous post and a all round entertaining blog (I also love the
    theme/design), I don’t have time to go through it all at the minute but I have bookmarked
    it and also included your RSS feeds, so when I have time I will be back to read more, Please
    do keep up the excellent work.

    Also visit my website :: https://earlyretirementnow.com/Forum/profile/nielsenphilip

  34. I wanted to follow along and allow you to know how great I treasured discovering
    your website today. I’d personally consider it a honor
    to work at my workplace and be able to use the tips shared on your web page and also get involved in visitors’ feedback like this.
    Should a position involving guest article author become offered
    at your end, make sure you let me know.

    Also visit my webpage :: http://www.1stanapa.ru/modules.php?name=Your_Account&op=userinfo&username=MacGregorDeneen

  35. I don’t even understand how I stopped up here, but I believed this publish was once great.
    I do not know who you might be however certainly you’re going to a well-known blogger in case you are not already.
    Cheers!

    Here is my website :: conorneill.com

  36. hello there and thank you for your info ? I?ve certainly picked up something new from right here.
    I did however expertise some technical issues using this web site, since
    I experienced to reload the website lots of times previous to I could
    get it to load properly. I had been wondering if your web
    hosting is OK? Not that I am complaining, but slow loading instances times will often affect your placement in google and
    could damage your high-quality score if advertising and marketing with Adwords.
    Well I?m adding this RSS to my email and can look out for a lot more of your
    respective intriguing content. Make sure you update this again soon..

    Here is my web blog :: coursebuddy.meltdowndesigner.com

  37. Hello, I believe your site might be having web browser compatibility issues.
    Whenever I take a look at your site in Safari, it looks
    fine however, if opening in Internet Explorer, it’s got some overlapping issues.
    I just wanted to provide you with a quick heads up! Aside
    from that, great site!

    Review my web-site: logc194.xiti.com

  38. Greetіngs from California! I’m bored to tearѕ at work so I decided to check out օur sife on my iphone during lunch
    break. I love the info you prfesent here andd can’t wait to take a looҝ when I get
    home. I’m amazeԀ at how faѕt your blog loaded onn my cell phоne ..
    I’m not even using WІFI, just 3G .. Anyԝays, gooԁ site!

  39. I was wondering if you ever considered changing the layout
    of your site? Its very well written; I love what youve got to say.
    But maybe you could a little more in the way of content so people could connect with it better.
    Youve got an awful lot of text for only having 1 or 2 images.
    Maybe you could space it out better?

    my page – bostonsoftwaregroup.us

  40. What’s Happening i’m new to this, I stumbled upon this I’ve found It
    absolutely useful and it has helped me out loads. I am hoping to give a contribution & help other users like its helped me.
    Good job.

    Feel free to visit my web page … center4mi.org

  41. Have you ever thought about creating an ebook or guest authoring on other
    websites? I have a blog based on the same ideas you discuss and
    would love to have you share some stories/information. I know my subscribers would appreciate
    your work. If you’re even remotely interested, feel free to shoot me an e-mail.

    my webpage 年代.xn--cksr0a.tw

  42. What i don’t understood is if truth be told how you are no longer actually a lot more neatly-appreciated than you might be now.
    You are very intelligent. You realize thus significantly when it
    comes to this topic, produced me individually consider it from numerous
    numerous angles. Its like women and men don’t seem to be interested until it’s something to
    do with Girl gaga! Your own stuffs nice.
    At all times deal with it up!

    Look at my web page http://science-marketplace.org

  43. Its like you read my mind! You seem to understand so much about this,
    such as you wrote the guide in it or something. I believe that you can do with some
    % to drive the message house a bit, however other than that,
    that is magnificent blog. A fantastic read. I will certainly
    be back.

    Feel free to surf to my web blog catamarancentral.com

  44. Very well written post. It will be valuable to everyone who utilizes it, as
    well as yours truly :). Keep up the good work – looking forward to more posts.

    Feel free to surf to my blog :: http://support.kaktusancorp.com/phpads/adclick.php?bannerid=33&zoneid=30&source=&dest=https://www.1390.com.tw/%3Fd=www.feelwind.jp/bbs/yybbs.cgi

  45. Great blog! Do you have any helpful hints for aspiring writers?
    I’m hoping to start my own blog soon but I’m a
    little lost on everything. Would you recommend starting with a
    free platform like WordPress or go for a paid option? There are so many options out there that I’m completely confused ..
    Any recommendations? Kudos!

  46. Ꮲretty sectiоn of content. I just stumƅled upon your weЬloց and in accession capital to ѕay that I get actuаlly enjoyed account
    your log posts. Any way I will bee subscribing on your augment oor even I success you ɡet entry to
    constantly fast.

  47. Does your blog have a contact page? I’m having a tough
    time locating it but, I’d like to shoot you an e-mail. I’ve got some ideas for your blog you might be
    interested in hearing. Either way, great website and I look forward to seeing it expand over time.

    Also visit my page … diecast.org

  48. I was wondering if you ever thought of changing the layout
    of your site? Its very well written; I love what youve got to
    say. But maybe you could a little more in the way of content
    so people could connect with it better. Youve got an awful
    lot of text for only having 1 or 2 pictures. Maybe you could space it out better?

    Look at my site … buildingabettercolorado.org

  49. The four-way linking works pretty well at once. But they
    do not exactly what lies in each segment of the SEO service.
    Another approach to generate money from your
    site is from google adsense.

  50. We read with our mind and employ our imagination to paint the setting of
    the detective thriller we are reading. Anybody who gives dating relationship advice always
    emphasizes on having good communication skills.

  51. I do believe all of the concepts you’ve introduced to your post.
    They are very convincing and will certainly work. Still, the posts are very quick
    for beginners. Could you please extend them a bit from next time?
    Thank you for the post.

    Also visit my webpage: freeholmes.com

  52. Having read this I believed it was rather enlightening. I appreciate you taking the time and energy to put this content
    together. I once again find myself spending way too much time both reading and leaving
    comments. But so what, it was still worthwhile!

    my blog post – lovegamematch.com

  53. Hey just wanted to give you a quick heads up.
    The words in your content seem to be running off the screen in Ie.
    I’m not sure if this is a formatting issue or
    something to do with web browser compatibility but I thought I’d post to let you know.

    The design look great though! Hope you get the problem resolved
    soon. Cheers

    my web blog; http://www.gaoqiaocs.com

  54. Hello, Neat post. There’s an issue with your website in web
    explorer, would test this? IE still is the marketplace chief and a large
    part of people will miss your wonderful writing due to this problem.

    Here is my website – atomy123.cn

  55. I’ve been exploring for a little bit for any high quality
    articles or blog posts in this kind of house . Exploring in Yahoo I ultimately stumbled upon this web site.
    Reading this info So i’m happy to express that I’ve an incredibly excellent uncanny feeling
    I discovered exactly what I needed. I most certainly will make sure to do
    not put out of your mind this site and provides it a
    look regularly.

    My web page – oigari.com

  56. An interesting discussion is definitely worth comment.
    I do think that you should write more on this subject, it may not be a
    taboo subject but usually people don’t talk about such topics.
    To the next! Best wishes!!

Leave a Reply

Your email address will not be published. Required fields are marked *