{"id":2221,"date":"2024-08-18T17:05:41","date_gmt":"2024-08-18T15:05:41","guid":{"rendered":"http:\/\/192.168.1.213:8088\/?p=2221"},"modified":"2024-10-02T08:29:06","modified_gmt":"2024-10-02T06:29:06","slug":"my-journey-from-esxi-to-proxmox","status":"publish","type":"post","link":"http:\/\/192.168.1.213:8088\/my-journey-from-esxi-to-proxmox\/","title":{"rendered":"My journey from ESXi to Proxmox"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"2221\" class=\"elementor elementor-2221\" data-elementor-post-type=\"post\">\n\t\t\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-60a7725 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"60a7725\" data-element_type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-4cdb442\" data-id=\"4cdb442\" data-element_type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-5840e53 elementor-toc--minimized-on-tablet elementor-widget elementor-widget-table-of-contents\" data-id=\"5840e53\" data-element_type=\"widget\" data-settings=\"{&quot;headings_by_tags&quot;:[&quot;h5&quot;,&quot;h6&quot;],&quot;exclude_headings_by_selector&quot;:[],&quot;marker_view&quot;:&quot;bullets&quot;,&quot;icon&quot;:{&quot;value&quot;:&quot;fas fa-circle&quot;,&quot;library&quot;:&quot;fa-solid&quot;},&quot;minimize_box&quot;:&quot;yes&quot;,&quot;minimized_on&quot;:&quot;tablet&quot;,&quot;hierarchical_view&quot;:&quot;yes&quot;,&quot;min_height&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]},&quot;min_height_tablet&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]},&quot;min_height_mobile&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"table-of-contents.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-toc__header\">\n\t\t\t<h4 class=\"elementor-toc__header-title\">\n\t\t\t\tTable of Contents\t\t\t<\/h4>\n\t\t\t\t\t\t\t<div class=\"elementor-toc__toggle-button elementor-toc__toggle-button--expand\" role=\"button\" tabindex=\"0\" aria-controls=\"elementor-toc__5840e53\" aria-expanded=\"true\" aria-label=\"Open table of contents\"><i aria-hidden=\"true\" class=\"fas fa-chevron-down\"><\/i><\/div>\n\t\t\t\t<div class=\"elementor-toc__toggle-button elementor-toc__toggle-button--collapse\" role=\"button\" tabindex=\"0\" aria-controls=\"elementor-toc__5840e53\" aria-expanded=\"true\" aria-label=\"Close table of contents\"><i aria-hidden=\"true\" class=\"fas fa-chevron-up\"><\/i><\/div>\n\t\t\t\t\t<\/div>\n\t\t<div id=\"elementor-toc__5840e53\" class=\"elementor-toc__body\">\n\t\t\t<div class=\"elementor-toc__spinner-container\">\n\t\t\t\t<i class=\"elementor-toc__spinner eicon-animation-spin eicon-loading\" aria-hidden=\"true\"><\/i>\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-e15f4dd elementor-widget elementor-widget-heading\" data-id=\"e15f4dd\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h5 class=\"elementor-heading-title elementor-size-default\">The Wake-Up Call: A Beeping Sound in the Night<\/h5>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-a73c95e elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"a73c95e\" data-element_type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-50 elementor-inner-column elementor-element elementor-element-70b057b\" data-id=\"70b057b\" data-element_type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-cb142d2 elementor-widget__width-initial elementor-widget elementor-widget-text-editor\" data-id=\"cb142d2\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>With this blog article I am creating a new category which is all about Home Lab deployments and related topics.<\/p><p>It all started with a loud beeping sound in the middle of the night. My wife woke me up, understandably annoyed, and demanded to know what was causing the noise. Still half-asleep, I quickly realized it was coming from my office. My APC battery backup had failed, with the &#8220;battery replace&#8221; indicator flashing constantly.<\/p><p>In a sleep-deprived state, I disconnected the APC and rewired my rack to draw power directly from the wall outlet. The result? An unplanned reboot of everything in my home lab.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t<div class=\"elementor-column elementor-col-50 elementor-inner-column elementor-element elementor-element-a0cb868\" data-id=\"a0cb868\" data-element_type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-8bc2e3f elementor-widget elementor-widget-image\" data-id=\"8bc2e3f\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t<img fetchpriority=\"high\" decoding=\"async\" width=\"526\" height=\"401\" src=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_004.svg\" class=\"attachment-large size-large wp-image-2229\" alt=\"\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-451edbb elementor-widget elementor-widget-text-editor\" data-id=\"451edbb\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>Source: <a href=\"https:\/\/pve.proxmox.com\/pve-docs\/pve-admin-guide.html#chapter_pvecm\" target=\"_blank\" rel=\"noopener\">https:\/\/pve.proxmox.com\/pve-docs\/pve-admin-guide.html#chapter_pvecm<\/a><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-4a93ca0 elementor-widget elementor-widget-heading\" data-id=\"4a93ca0\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h5 class=\"elementor-heading-title elementor-size-default\">A Sign to Move On<\/h5>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-2d1fb00 elementor-widget__width-initial elementor-widget elementor-widget-text-editor\" data-id=\"2d1fb00\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>When my VMs running on VMware ESXi finally came back online, I noticed something important: my VMware license was about to expire. Rather than renewing, I took it as a sign to finally do what I&#8217;d been planning for a while\u2014migrate to Proxmox, an open-source hypervisor that I&#8217;d heard great things about.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-2b69dc1 elementor-widget elementor-widget-image\" data-id=\"2b69dc1\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"800\" height=\"282\" src=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_001.png\" class=\"attachment-large size-large wp-image-2223\" alt=\"\" srcset=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_001.png 806w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_001-300x106.png 300w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_001-768x271.png 768w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-dd2542c elementor-widget elementor-widget-heading\" data-id=\"dd2542c\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h5 class=\"elementor-heading-title elementor-size-default\">First Hurdle: The Blackout<\/h5>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-8cc434a elementor-widget__width-initial elementor-widget elementor-widget-text-editor\" data-id=\"8cc434a\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>In my home lab, I am running two Intel NUC devices. The first thing I needed to do was migrate all workloads from one to another to free up the node to install Proxmox.\u00a0<\/p><p>Thats where my first problem started to begin. I created the bootable USB stick and wanted to start the installation process but no matter what installation option I chose the screen immediately went black and I had no output anymore. I tried different boot parameters in GRUB to define the screen resolution but nothing worked. So I thought great before my journey started it already end! But then I just tried to unplug and plug back in the HDMI cable (plug and prey) and &#8230; I finally had an output. If I try that earlier it saves me some hours.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-7e4f45d elementor-widget elementor-widget-heading\" data-id=\"7e4f45d\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h5 class=\"elementor-heading-title elementor-size-default\">Migration from VMware to Proxmox: Easier Than Expected<\/h5>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-f4eb941 elementor-widget elementor-widget-text-editor\" data-id=\"f4eb941\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>The migration itself, which I thought would be a major headache, turned out to be quite simple. I added my VMware storage to Proxmox and followed the steps in <a href=\"https:\/\/pve.proxmox.com\/wiki\/Migrate_to_Proxmox_VE#Automatic_Import_of_Full_VM\" target=\"_new\" rel=\"noopener\">this guide<\/a>. Despite my 1Gbit network limiting transfer speeds, I successfully migrated all my VMs.<\/p><p>After the migration, I made sure to follow Proxmox&#8217;s best practices for VM configuration:<\/p><ul><li><strong>CPU<\/strong>: I set the CPU type to &#8220;host&#8221; since both my NUCs have the same architecture.<\/li><li><strong>Network<\/strong>: I switched to VirtIO for minimal overhead.<\/li><li><strong>Memory<\/strong>: Enabled the &#8220;Ballooning Device&#8221; for better memory management.<\/li><li><strong>Disks<\/strong>: Configured SCSI with VirtIO SCSI single, enabled Discard, and activated IO threads.<\/li><li><strong>Qemu<\/strong>: Installed the QEMU guest agent in all VMs for improved host-guest communication.<\/li><\/ul>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-a6db2de elementor-widget elementor-widget-image\" data-id=\"a6db2de\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<a href=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_002.png\" data-elementor-open-lightbox=\"yes\" data-e-action-hash=\"#elementor-action%3Aaction%3Dlightbox%26settings%3DeyJpZCI6MjIyNywidXJsIjoiaHR0cDpcL1wvMTkyLjE2OC4xLjIxMzo4MDg4XC93cC1jb250ZW50XC91cGxvYWRzXC8yMDI0XC8wOFwvTXlfam91cm5leV9mcm9tX0VTWGlfdG9fUHJveG1veF8wMDIucG5nIn0%3D\">\n\t\t\t\t\t\t\t<img decoding=\"async\" width=\"800\" height=\"330\" src=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_002-1024x423.png\" class=\"attachment-large size-large wp-image-2227\" alt=\"\" srcset=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_002-1024x423.png 1024w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_002-300x124.png 300w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_002-768x317.png 768w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_002-1536x634.png 1536w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_002.png 1743w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/>\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-baa366c elementor-widget elementor-widget-text-editor\" data-id=\"baa366c\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>For the most part, the transition went smoothly, especially with my Ubuntu-based VMs. The only minor hiccup was updating the interface name in the network config due to a change in the naming convention.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-c6b3220 elementor-widget elementor-widget-image\" data-id=\"c6b3220\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<a href=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_003.png\" data-elementor-open-lightbox=\"yes\" data-e-action-hash=\"#elementor-action%3Aaction%3Dlightbox%26settings%3DeyJpZCI6MjIyOCwidXJsIjoiaHR0cDpcL1wvMTkyLjE2OC4xLjIxMzo4MDg4XC93cC1jb250ZW50XC91cGxvYWRzXC8yMDI0XC8wOFwvTXlfam91cm5leV9mcm9tX0VTWGlfdG9fUHJveG1veF8wMDMucG5nIn0%3D\">\n\t\t\t\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"800\" height=\"461\" src=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_003-1024x590.png\" class=\"attachment-large size-large wp-image-2228\" alt=\"\" srcset=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_003-1024x590.png 1024w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_003-300x173.png 300w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_003-768x443.png 768w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_003-1536x885.png 1536w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_003-2048x1180.png 2048w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/>\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-94f1f07 elementor-widget elementor-widget-heading\" data-id=\"94f1f07\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h5 class=\"elementor-heading-title elementor-size-default\">Windows 11 Bluescreen: A Blast from the Past<\/h5>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-563bbb4 elementor-widget elementor-widget-text-editor\" data-id=\"563bbb4\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>One of my VMs running Windows 11 wasn&#8217;t as cooperative. After the migration, I was greeted by the popular bluescreen. I tried safe mode, installed the QEMU driver, and rebooted\u2014only to be met with the same result. After some digging, I found the solution: <strong>set the CPU type to x86-64-v2-AES<\/strong>.<\/p><p>This simple change fixed the issue, and the VM booted without further problems.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3ea7c22 elementor-widget elementor-widget-heading\" data-id=\"3ea7c22\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h5 class=\"elementor-heading-title elementor-size-default\">Building a cluster<\/h5>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-57a53c9 elementor-widget elementor-widget-text-editor\" data-id=\"57a53c9\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>With the first NUC running smoothly, it was time to install Proxmox on the second one. The installation took some minutes, and I quickly set up a cluster. While a third node is typically recommended, I repurposed an old ESX node for the job.<\/p><p>Creating the cluster was surprisingly straightforward, and within an hour, everything was up and running.<\/p><p>To create a cluster just follow the instructions:<\/p><p><a href=\"https:\/\/pve.proxmox.com\/pve-docs\/pve-admin-guide.html#pvecm_create_cluster\" target=\"_blank\" rel=\"noopener\">https:\/\/pve.proxmox.com\/pve-docs\/pve-admin-guide.html#pvecm_create_cluster<\/a><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-2539c89 elementor-widget elementor-widget-image\" data-id=\"2539c89\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<a href=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_005.png\" data-elementor-open-lightbox=\"yes\" data-e-action-hash=\"#elementor-action%3Aaction%3Dlightbox%26settings%3DeyJpZCI6MjIzMCwidXJsIjoiaHR0cDpcL1wvMTkyLjE2OC4xLjIxMzo4MDg4XC93cC1jb250ZW50XC91cGxvYWRzXC8yMDI0XC8wOFwvTXlfam91cm5leV9mcm9tX0VTWGlfdG9fUHJveG1veF8wMDUucG5nIn0%3D\">\n\t\t\t\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"800\" height=\"261\" src=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_005-1024x334.png\" class=\"attachment-large size-large wp-image-2230\" alt=\"\" srcset=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_005-1024x334.png 1024w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_005-300x98.png 300w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_005-768x251.png 768w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_005-1536x501.png 1536w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_005.png 1569w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/>\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-1cd4b1e elementor-widget elementor-widget-text-editor\" data-id=\"1cd4b1e\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>It was a matter of less than an hour to install my two nodes and create a cluster! Wow, I am amazed!\u00a0<\/p><p>Having a cluster is fine but I also should have a shared storage. So I created a NFS share on my old QNAP added it and migrated one VM to the NFS share which works okay but is not ideal due to the performance of the NAS.\u00a0<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-cc30ce4 elementor-widget elementor-widget-heading\" data-id=\"cc30ce4\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h5 class=\"elementor-heading-title elementor-size-default\">Shared Storage and Backup Solutions<\/h5>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-0718714 elementor-widget elementor-widget-text-editor\" data-id=\"0718714\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>Having a cluster is great, but it\u2019s essential to have shared storage for optimal performance. I created an NFS share on my QNAP NAS and migrated a VM over. Though the performance isn\u2019t great, it works for now.<\/p><p>Next, I explored Proxmox\u2019s built-in backup functions\u2014something that was long overdue in my home lab. Setting up scheduled backups to an NFS share was simple, and yes, I tested the restore process too. It worked like a charm.<\/p><p>Proxmox also offers a dedicated backup server with advanced features like deduplication. I added this to my setup, created a new backup schedule, and was impressed by how efficiently it worked.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-ce1385d elementor-widget elementor-widget-image\" data-id=\"ce1385d\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<a href=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_006.png\" data-elementor-open-lightbox=\"yes\" data-e-action-hash=\"#elementor-action%3Aaction%3Dlightbox%26settings%3DeyJpZCI6MjIzMSwidXJsIjoiaHR0cDpcL1wvMTkyLjE2OC4xLjIxMzo4MDg4XC93cC1jb250ZW50XC91cGxvYWRzXC8yMDI0XC8wOFwvTXlfam91cm5leV9mcm9tX0VTWGlfdG9fUHJveG1veF8wMDYucG5nIn0%3D\">\n\t\t\t\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"800\" height=\"409\" src=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_006-1024x523.png\" class=\"attachment-large size-large wp-image-2231\" alt=\"\" srcset=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_006-1024x523.png 1024w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_006-300x153.png 300w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_006-768x392.png 768w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_006-1536x785.png 1536w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_006.png 1750w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/>\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-5f2536c elementor-widget elementor-widget-image\" data-id=\"5f2536c\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<a href=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_007.png\" data-elementor-open-lightbox=\"yes\" data-e-action-hash=\"#elementor-action%3Aaction%3Dlightbox%26settings%3DeyJpZCI6MjIzMiwidXJsIjoiaHR0cDpcL1wvMTkyLjE2OC4xLjIxMzo4MDg4XC93cC1jb250ZW50XC91cGxvYWRzXC8yMDI0XC8wOFwvTXlfam91cm5leV9mcm9tX0VTWGlfdG9fUHJveG1veF8wMDcucG5nIn0%3D\">\n\t\t\t\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"800\" height=\"177\" src=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_007-1024x227.png\" class=\"attachment-large size-large wp-image-2232\" alt=\"\" srcset=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_007-1024x227.png 1024w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_007-300x66.png 300w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_007-768x170.png 768w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_007-1536x340.png 1536w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_007.png 1868w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/>\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-6faa27d elementor-widget elementor-widget-heading\" data-id=\"6faa27d\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h6 class=\"elementor-heading-title elementor-size-default\">Backup Issues and Workarounds<\/h6>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-eb9acdb elementor-widget elementor-widget-text-editor\" data-id=\"eb9acdb\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>While I\u2019m overall happy with the setup, I did encounter some issues. Specifically, the VM running on NFS storage occasionally hangs right after a snapshot is taken.<\/p><p>The only solution so far has been to manually reboot the VM. I\u2019m still looking into a more permanent fix for this.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-c3c6d1a elementor-widget elementor-widget-heading\" data-id=\"c3c6d1a\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h5 class=\"elementor-heading-title elementor-size-default\">Telemetry server<\/h5>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3b720fd elementor-widget elementor-widget-text-editor\" data-id=\"3b720fd\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>While exploring Proxmox\u2019s features, I discovered its telemetry capabilities. You can connect Proxmox to an InfluxDB server and monitor the entire cluster via Grafana. By importing this dashboard, you can get detailed statistics on your cluster.<\/p><p>The level of insight this provides is incredible.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-7ca4215 elementor-widget elementor-widget-image\" data-id=\"7ca4215\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<a href=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_008.png\" data-elementor-open-lightbox=\"yes\" data-e-action-hash=\"#elementor-action%3Aaction%3Dlightbox%26settings%3DeyJpZCI6MjIzNiwidXJsIjoiaHR0cDpcL1wvMTkyLjE2OC4xLjIxMzo4MDg4XC93cC1jb250ZW50XC91cGxvYWRzXC8yMDI0XC8wOFwvTXlfam91cm5leV9mcm9tX0VTWGlfdG9fUHJveG1veF8wMDgucG5nIn0%3D\">\n\t\t\t\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"800\" height=\"413\" src=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_008-1024x529.png\" class=\"attachment-large size-large wp-image-2236\" alt=\"\" srcset=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_008-1024x529.png 1024w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_008-300x155.png 300w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_008-768x397.png 768w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_008-1536x794.png 1536w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_008.png 1751w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/>\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-050d498 elementor-widget elementor-widget-image\" data-id=\"050d498\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<a href=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_009.png\" data-elementor-open-lightbox=\"yes\" data-e-action-hash=\"#elementor-action%3Aaction%3Dlightbox%26settings%3DeyJpZCI6MjIzNywidXJsIjoiaHR0cDpcL1wvMTkyLjE2OC4xLjIxMzo4MDg4XC93cC1jb250ZW50XC91cGxvYWRzXC8yMDI0XC8wOFwvTXlfam91cm5leV9mcm9tX0VTWGlfdG9fUHJveG1veF8wMDkucG5nIn0%3D\">\n\t\t\t\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"800\" height=\"361\" src=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_009-1024x462.png\" class=\"attachment-large size-large wp-image-2237\" alt=\"\" srcset=\"http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_009-1024x462.png 1024w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_009-300x135.png 300w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_009-768x346.png 768w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_009-1536x693.png 1536w, http:\/\/192.168.1.213:8088\/wp-content\/uploads\/2024\/08\/My_journey_from_ESXi_to_Proxmox_009-2048x924.png 2048w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/>\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-1948c3a elementor-widget elementor-widget-heading\" data-id=\"1948c3a\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h5 class=\"elementor-heading-title elementor-size-default\">Importing OVA<\/h5>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-6d568f7 elementor-widget elementor-widget-text-editor\" data-id=\"6d568f7\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>If you want to import a VM from a vendor, they will most likely provide you with an OVA file. So, how do you import an OVA into Proxmox? Unlike ESX, the process isn&#8217;t as straightforward, but it&#8217;s manageable with the right steps.<\/p><p>Here\u2019s how I successfully imported some VMs for testing:<\/p><p><strong>1. Extract the OVA file<\/strong><br \/>An OVA file is essentially a tar archive that contains a .vmdk file (the virtual disk) and an .ovf file (metadata). You need to extract these files first.<\/p><p>Use the following command to extract the OVA file:<\/p><ul><li><strong>tar -xvf your-file.ova<\/strong><\/li><li>After extraction, you&#8217;ll get a .vmdk file and an .ovf file.<\/li><\/ul><p><strong>2. Convert the VMDK to QCOW2 (optional)<\/strong><\/p><p>Proxmox works better with QCOW2 images, so it\u2019s recommended to convert the VMDK file.<\/p><ul><li>Convert the VMDK to QCOW2 using the qemu-img tool:<\/li><li>qemu-img convert -f vmdk your-disk.vmdk -O qcow2 your-disk.qcow2<\/li><\/ul><p><strong>3. Create a new VM in Proxmox<\/strong><\/p><ul><li>Go to the Proxmox web interface.<\/li><li>Create a new VM: Set the VM ID, name, and other options as desired.<br \/>Skip adding a disk during creation.<\/li><\/ul><p><strong>4. Import the Disk to the VM<\/strong><\/p><ul><li>Import the converted disk (qcow2 or vmdk) to your VM&#8217;s storage.<\/li><li>qm importdisk &lt;VM_ID&gt; your-disk.qcow2 local-lvm<br \/>Replace &lt;VM_ID&gt; with the ID of your VM and local-lvm with your storage name.<\/li><\/ul><p><strong>5. Attach the Disk to the VM<\/strong><\/p><ul><li>Go to the hardware tab of your VM.<\/li><li>Add the imported disk as a SCSI or VirtIO disk.<\/li><li>Remove the unused disk if any.<\/li><\/ul><p><strong>6. Adjust VM Configuration (optional)<\/strong><\/p><ul><li>Check the Hardware settings of the VM and ensure network adapters, memory, and CPUs are set as needed.<\/li><\/ul><p><strong>7. Start the VM<\/strong><\/p><ul><li>Start your VM from the Proxmox web interface.<\/li><\/ul>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-442c085 elementor-widget elementor-widget-heading\" data-id=\"442c085\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h5 class=\"elementor-heading-title elementor-size-default\">Conclusion<\/h5>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-6659f50 elementor-widget elementor-widget-text-editor\" data-id=\"6659f50\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>This migration journey has been full of learning experiences, some frustrating and others rewarding. Proxmox has proven to be a powerful and flexible platform for my home lab, offering features that make management and monitoring far more efficient than my previous setup.<\/p><h6>Pros of Using Proxmox Over ESX<\/h6><ul><li><p><strong>Cost-Effective<\/strong>: Proxmox is an open-source hypervisor, meaning there are no licensing fees. This makes it a budget-friendly alternative to ESX, which requires a paid license for full functionality.<\/p><\/li><li><p><strong>Flexibility and Freedom<\/strong>: Proxmox offers more flexibility, allowing you to avoid vendor lock-in. You can customize and configure the system to suit your specific needs without being tied to proprietary solutions.<\/p><\/li><li><p><strong>Built-In Features<\/strong>: Proxmox comes with built-in features like backup and clustering, which are either not available or require additional licenses in ESX. This includes the ability to set up a cluster without needing a separate vCenter server.<\/p><\/li><li><p><strong>Community Support and Documentation<\/strong>: As an open-source project, Proxmox benefits from a robust community that actively contributes to its development and offers extensive documentation. This can be invaluable when troubleshooting or exploring new features.<\/p><\/li><li><p><strong>Ease of Migration<\/strong>: Despite initial concerns, migrating VMs from ESX to Proxmox proved to be straightforward, especially with the step-by-step guides available in the Proxmox community.<\/p><\/li><li><p><strong>Integrated Monitoring<\/strong>: Proxmox integrates well with popular monitoring tools like Grafana and InfluxDB, allowing for detailed telemetry and performance monitoring out of the box.<\/p><\/li><li><p><strong>Advanced Storage Options<\/strong>: Proxmox supports a wide range of storage types, including local storage, shared NFS, and more. It also provides advanced options like thin provisioning and deduplication when using the Proxmox Backup Server.<\/p><\/li><li><p><strong>No Black Box<\/strong>: Unlike ESX, where some functions can feel like a black box, Proxmox is transparent, giving you full control and visibility over your virtualized environment.<\/p><\/li><\/ul><p><strong>Stay tuned for more posts in this new Home Lab category as I continue to explore what Proxmox has to offer and share my experiences with you!<\/strong><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-4c85521 elementor-widget elementor-widget-heading\" data-id=\"4c85521\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h5 class=\"elementor-heading-title elementor-size-default\">References<\/h5>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-272cfe2 elementor-widget elementor-widget-text-editor\" data-id=\"272cfe2\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<ul><li><a href=\"https:\/\/www.proxmox.com\/en\/\" target=\"_blank\" rel=\"noopener\">https:\/\/www.proxmox.com\/en\/<\/a><\/li><li><a href=\"https:\/\/pve.proxmox.com\/pve-docs\/pve-admin-guide.html#_introduction\" target=\"_blank\" rel=\"noopener\">https:\/\/pve.proxmox.com\/pve-docs\/pve-admin-guide.html#_introduction<\/a><\/li><li><a href=\"https:\/\/pve.proxmox.com\/wiki\/Migrate_to_Proxmox_VE#Concepts\" target=\"_blank\" rel=\"noopener\">https:\/\/pve.proxmox.com\/wiki\/Migrate_to_Proxmox_VE#Concepts<\/a><\/li><li><a href=\"https:\/\/pbs.proxmox.com\/docs\/\" target=\"_blank\" rel=\"noopener\">https:\/\/pbs.proxmox.com\/docs\/<\/a><\/li><\/ul>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Table of Contents The Wake-Up Call: A Beeping Sound in the Night With this blog article I am creating a new category which is all about Home Lab deployments and related topics. It all started with a loud beeping sound in the middle of the night. My wife woke me up, understandably annoyed, and demanded [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":2250,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"rank_math_lock_modified_date":false,"footnotes":""},"categories":[21],"tags":[],"class_list":["post-2221","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-home-lab"],"_links":{"self":[{"href":"http:\/\/192.168.1.213:8088\/wp-json\/wp\/v2\/posts\/2221"}],"collection":[{"href":"http:\/\/192.168.1.213:8088\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/192.168.1.213:8088\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/192.168.1.213:8088\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"http:\/\/192.168.1.213:8088\/wp-json\/wp\/v2\/comments?post=2221"}],"version-history":[{"count":25,"href":"http:\/\/192.168.1.213:8088\/wp-json\/wp\/v2\/posts\/2221\/revisions"}],"predecessor-version":[{"id":2285,"href":"http:\/\/192.168.1.213:8088\/wp-json\/wp\/v2\/posts\/2221\/revisions\/2285"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/192.168.1.213:8088\/wp-json\/wp\/v2\/media\/2250"}],"wp:attachment":[{"href":"http:\/\/192.168.1.213:8088\/wp-json\/wp\/v2\/media?parent=2221"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/192.168.1.213:8088\/wp-json\/wp\/v2\/categories?post=2221"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/192.168.1.213:8088\/wp-json\/wp\/v2\/tags?post=2221"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}