Farmbot offline, logs show cyclical pattern


#21

@connor Could you provide a link?
The download I get from this page wants to save the file as 7.0.1


#22

@Holualoa_School Please check out https://github.com/FarmBot/farmbot_os/releases for a list of pre-releases


#23

Doomo arigato.


#24

Downloaded and flashed Farmbot OS 7.0.3, ran setup wizard and waited.
Farmbot was thereafter connected and I was able to move Farmbot using the Controls page as well as re-install some custom Farmware.

The only thing left to do was to hit the Sync button, and this is where things go awry.

The following is the log pre-syncing:

Success Downloaded Farmware tools: https://api.github.com/repos/FarmBot-Labs/farmware-tools/releases/latest 0, 0, 0 Apr 12, 1:29pm
Busy Downloading Farmware tools: https://api.github.com/repos/FarmBot-Labs/farmware-tools/releases/latest 0, 0, 0 Apr 12, 1:29pm
Success Finishing install for #Farmware<Weed Zapper(1.0.2)> 0, 0, 0 Apr 12, 1:29pm
Info Checking directories for Weed Zapper - 1.0.2 0, 0, 0 Apr 12, 1:29pm
Info Starting preflight checks for #Farmware<Weed Zapper(1.0.2)> 0, 0, 0 Apr 12, 1:29pm
Busy Installing farmware from https://raw.githubusercontent.com/MakotoNinja/weed-zapper/master/manifest.json. 0, 0, 0 Apr 12, 1:29pm
Success Downloaded Farmware tools: https://api.github.com/repos/FarmBot-Labs/farmware-tools/releases/latest 0, 0, 0 Apr 12, 1:29pm
Busy Downloading Farmware tools: https://api.github.com/repos/FarmBot-Labs/farmware-tools/releases/latest 0, 0, 0 Apr 12, 1:29pm
Success Finishing install for #Farmware<Audrey II(1.0.3)> 0, 0, 0 Apr 12, 1:29pm
Info Checking directories for Audrey II - 1.0.3 0, 0, 0 Apr 12, 1:29pm
Info Starting preflight checks for #Farmware<Audrey II(1.0.3)> 0, 0, 0 Apr 12, 1:29pm
Busy Installing farmware from https://raw.githubusercontent.com/MakotoNinja/AudreyII/master/manifest.json. 0, 0, 0 Apr 12, 1:29pm
Success Movement to (0, 0, 0) complete. 0, 0, 0 Apr 12, 1:28pm
Debug Arduino debug message: error 0 0, 0, 0 Apr 12, 1:28pm
Debug Arduino debug message: stopped 0.6, 0, 0 Apr 12, 1:28pm
Debug Arduino debug message: error 0 700, 0, 0 Apr 12, 1:28pm
Debug Arduino debug message: stopped 700, 1.8, 0 Apr 12, 1:28pm
Busy Moving to (0, 0, 0) 700, 600, 0 Apr 12, 1:28pm
Success Movement to (700.0, 600.0, 0.0) complete. 700, 600, 0 Apr 12, 1:27pm
Busy Moving to (700.0, 600.0, 0.0) -0.2, 0, 0 Apr 12, 1:27pm
Success Updating: update_channel => "stable" 0, 0, 0 Apr 12, 1:18pm
Success Updating: sequence_init_log => false 0, 0, 0 Apr 12, 1:18pm
Success Updating: sequence_body_log => false 0, 0, 0 Apr 12, 1:18pm
Success Updating: disable_factory_reset => true 0, 0, 0 Apr 12, 1:18pm
Info API is the source of truth for Farmbot OS configs. Downloading data. 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: encoder_missed_steps_max_x: 5.0 => 10 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: movement_axis_nr_steps_z: 0.0 => 12183 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: encoder_missed_steps_max_y: 5.0 => 10 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: encoder_use_for_pos_y: 0.0 => 1 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: movement_stop_at_max_y: 0.0 => 1 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: pin_guard_5_time_out: 0.0 => 60 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: encoder_enabled_z: 0.0 => 1 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: pin_guard_5_active_state: 0.0 => 1 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: encoder_use_for_pos_z: 0.0 => 1 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: movement_stop_at_max_z: 0.0 => 1 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: movement_axis_nr_steps_x: 0.0 => 12849 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: movement_stop_at_max_x: 0.0 => 1 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: movement_max_spd_z: 400.0 => 600 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: pin_guard_3_active_state: 0.0 => 1 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: encoder_enabled_y: 0.0 => 1 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: encoder_missed_steps_max_z: 5.0 => 10 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: encoder_missed_steps_decay_x: 5.0 => 10 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: movement_keep_active_y: 0.0 => 1 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: pin_guard_3_time_out: 0.0 => 60 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: movement_keep_active_x: 0.0 => 1 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: pin_guard_4_active_state: 0.0 => 1 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: param_mov_nr_retry: 3.0 => 5 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: encoder_missed_steps_decay_y: 5.0 => 10 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: pin_guard_2_active_state: 0.0 => 1 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: encoder_enabled_x: 0.0 => 1 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: movement_home_at_boot_x: 0.0 => 1 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: pin_guard_1_time_out: 0.0 => 60 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: movement_axis_nr_steps_y: 0.0 => 5904 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: movement_max_spd_x: 400.0 => 600 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: movement_home_at_boot_z: 0.0 => 1 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: encoder_use_for_pos_x: 0.0 => 1 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: encoder_missed_steps_decay_z: 5.0 => 10 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: movement_max_spd_y: 400.0 => 600 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: movement_home_at_boot_y: 0.0 => 1 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: pin_guard_2_time_out: 0.0 => 60 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: pin_guard_1_active_state: 0.0 => 1 0, 0, 0 Apr 12, 1:18pm
Success Updating FW param: pin_guard_4_time_out: 0.0 => 60 0, 0, 0 Apr 12, 1:18pm
Info API is source of truth for fw configs. 0, 0, 0 Apr 12, 1:18pm
Success Downloaded Farmware tools: https://api.github.com/repos/FarmBot-Labs/farmware-tools/releases/latest 0, 0, 0 Apr 12, 1:18pm
Busy Downloading Farmware tools: https://api.github.com/repos/FarmBot-Labs/farmware-tools/releases/latest 0, 0, 0 Apr 12, 1:18pm
Success Finishing install for #Farmware<take-photo(1.0.2)> 0, 0, 0 Apr 12, 1:18pm
Info Checking directories for take-photo - 1.0.2 0, 0, 0 Apr 12, 1:18pm
Info Starting preflight checks for #Farmware<take-photo(1.0.2)> 0, 0, 0 Apr 12, 1:18pm
Busy Installing farmware from https://raw.githubusercontent.com/FarmBot-Labs/farmware_manifests/master/packages/take-photo/manifest.json. 0, 0, 0 Apr 12, 1:18pm
Success Downloaded Farmware tools: https://api.github.com/repos/FarmBot-Labs/farmware-tools/releases/latest 0, 0, 0 Apr 12, 1:18pm
Busy Downloading Farmware tools: https://api.github.com/repos/FarmBot-Labs/farmware-tools/releases/latest 0, 0, 0 Apr 12, 1:18pm
Success Finishing install for #Farmware<camera-calibration(0.0.1)> 0, 0, 0 Apr 12, 1:18pm
Info Checking directories for camera-calibration - 0.0.1 0, 0, 0 Apr 12, 1:18pm
Info Starting preflight checks for #Farmware<camera-calibration(0.0.1)> 0, 0, 0 Apr 12, 1:18pm
Busy Installing farmware from https://raw.githubusercontent.com/FarmBot-Labs/farmware_manifests/master/packages/camera-calibration/manifest.json. 0, 0, 0 Apr 12, 1:18pm
Success Downloaded Farmware tools: https://api.github.com/repos/FarmBot-Labs/farmware-tools/releases/latest 0, 0, 0 Apr 12, 1:18pm
Busy Downloading Farmware tools: https://api.github.com/repos/FarmBot-Labs/farmware-tools/releases/latest 0, 0, 0 Apr 12, 1:18pm
Success Finishing install for #Farmware<plant-detection(0.0.4)> 0, 0, 0 Apr 12, 1:18pm
Info Checking directories for plant-detection - 0.0.4 0, 0, 0 Apr 12, 1:18pm
Info Starting preflight checks for #Farmware<plant-detection(0.0.4)> 0, 0, 0 Apr 12, 1:18pm
Busy Installing farmware from https://raw.githubusercontent.com/FarmBot-Labs/farmware_manifests/master/packages/plant-detection/manifest.json. 0, 0, 0 Apr 12, 1:18pm
Success Downloaded Farmware tools: https://api.github.com/repos/FarmBot-Labs/farmware-tools/releases/latest 0, 0, 0 Apr 12, 1:18pm
Busy Downloading Farmware tools: https://api.github.com/repos/FarmBot-Labs/farmware-tools/releases/latest 0, 0, 0 Apr 12, 1:18pm
Success Finishing install for #Farmware<historical-camera-calibration(0.0.1)> 0, 0, 0 Apr 12, 1:18pm
Info Checking directories for historical-camera-calibration - 0.0.1 0, 0, 0 Apr 12, 1:18pm
Info Starting preflight checks for #Farmware<historical-camera-calibration(0.0.1)> 0, 0, 0 Apr 12, 1:18pm
Busy Installing farmware from https://raw.githubusercontent.com/FarmBot-Labs/farmware_manifests/master/packages/historical-camera-calibration/manifest.json. 0, 0, 0 Apr 12, 1:18pm
Success Downloaded Farmware tools: https://api.github.com/repos/FarmBot-Labs/farmware-tools/releases/latest 0, 0, 0 Apr 12, 1:18pm
Info doing initial OTA configuration. 0, 0, 0 Apr 12, 1:18pm
Busy Downloading Farmware tools: https://api.github.com/repos/FarmBot-Labs/farmware-tools/releases/latest 0, 0, 0 Apr 12, 1:18pm
Success Farmbot is up and running! 0, 0, 0 Apr 12, 1:18pm
Success Finishing install for #Farmware<historical-plant-detection(0.0.1)> 0, 0, 0 Apr 12, 1:18pm
Info Checking directories for historical-plant-detection - 0.0.1 0, 0, 0 Apr 12, 1:18pm
Info Starting preflight checks for #Farmware<historical-plant-detection(0.0.1)> 0, 0, 0 Apr 12, 1:18pm
Busy Installing farmware from https://raw.githubusercontent.com/FarmBot-Labs/farmware_manifests/master/packages/historical-plant-detection/manifest.json. 0, 0, 0 Apr 12, 1:18pm
Busy Syncing all Farmware repos. This may take a while. 0, 0, 0 Apr 12, 1:18pm
Success Firmware Initialized. 0, 0, 0 Apr 12, 1:18pm

And the log after trying to Sync:

Success Got ARDUINO STARTUP COMPLETE. UART is up. -1, -1, -1 Apr 12, 1:37pm
Debug Waiting for firmware idle. -1, -1, -1 Apr 12, 1:37pm
Debug Waiting for firmware idle. -1, -1, -1 Apr 12, 1:37pm
Debug Opening uart device: /dev/ttyACM0 -1, -1, -1 Apr 12, 1:37pm
Debug Uart handler init. -1, -1, -1 Apr 12, 1:37pm
Debug Ensuring /tmp/images/ exists. -1, -1, -1 Apr 12, 1:37pm
Success Successful Bootstrap authorization: farm.bot@holualoa.k12.hi.us - https://my.farm.bot -1, -1, -1 Apr 12, 1:37pm
Busy Beginning Bootstrap authorization: farm.bot@holualoa.k12.hi.us - https://my.farm.bot -1, -1, -1 Apr 12, 1:37pm
Debug FarmBot Server not configured yet. Waiting 10_000 ms to try OTA config again. -1, -1, -1 Apr 12, 1:37pm
Success DNS resolution successful -1, -1, -1 Apr 12, 1:37pm
Debug Ip address: 10.150.137.222 -1, -1, -1 Apr 12, 1:37pm
Debug Hacking tzdata. -1, -1, -1 Apr 12, 1:37pm
Success Interface eth0 is up. -1, -1, -1 Apr 12, 1:37pm
Busy Waiting for interface eth0 up. -1, -1, -1 Apr 12, 1:37pm
Info Starting Networking -1, -1, -1 Apr 12, 1:37pm
Busy Configuring Farmbot. -1, -1, -1 Apr 12, 1:37pm
Success detected target UART: /dev/ttyACM0 -1, -1, -1 Apr 12, 1:37pm
Busy Checking /root/boot -1, -1, -1 Apr 12, 1:37pm
Debug Loading kernel module: snd-bcm2835 -1, -1, -1 Apr 12, 1:37pm
Success Got ARDUINO STARTUP COMPLETE. UART is up. -1, -1, -1 Apr 12, 1:36pm
Debug Waiting for firmware idle. -1, -1, -1 Apr 12, 1:36pm
Debug Waiting for firmware idle. -1, -1, -1 Apr 12, 1:36pm
Debug Opening uart device: /dev/ttyACM0 -1, -1, -1 Apr 12, 1:36pm
Debug Uart handler init. -1, -1, -1 Apr 12, 1:36pm
Debug Ensuring /tmp/images/ exists. -1, -1, -1 Apr 12, 1:36pm
Success Successful Bootstrap authorization: farm.bot@holualoa.k12.hi.us - https://my.farm.bot -1, -1, -1 Apr 12, 1:36pm
Busy Beginning Bootstrap authorization: farm.bot@holualoa.k12.hi.us - https://my.farm.bot -1, -1, -1 Apr 12, 1:36pm
Debug FarmBot Server not configured yet. Waiting 10_000 ms to try OTA config again. -1, -1, -1 Apr 12, 1:36pm
Success DNS resolution successful -1, -1, -1 Apr 12, 1:36pm
Debug Ip address: 10.150.137.222 -1, -1, -1 Apr 12, 1:36pm
Debug Hacking tzdata. -1, -1, -1 Apr 12, 1:35pm
Success Interface eth0 is up. -1, -1, -1 Apr 12, 1:35pm
Busy Waiting for interface eth0 up. -1, -1, -1 Apr 12, 1:35pm
Info Starting Networking -1, -1, -1 Apr 12, 1:35pm
Busy Configuring Farmbot. -1, -1, -1 Apr 12, 1:35pm
Success detected target UART: /dev/ttyACM0 -1, -1, -1 Apr 12, 1:35pm
Busy Checking /root/boot -1, -1, -1 Apr 12, 1:35pm
Debug Loading kernel module: snd-bcm2835 -1, -1, -1 Apr 12, 1:35pm
Success Got ARDUINO STARTUP COMPLETE. UART is up. -1, -1, -1 Apr 12, 1:34pm
Debug Waiting for firmware idle. -1, -1, -1 Apr 12, 1:34pm
Debug Waiting for firmware idle. -1, -1, -1 Apr 12, 1:34pm
Debug Opening uart device: /dev/ttyACM0 -1, -1, -1 Apr 12, 1:34pm
Debug Uart handler init. -1, -1, -1 Apr 12, 1:34pm
Debug Ensuring /tmp/images/ exists. -1, -1, -1 Apr 12, 1:34pm
Success Successful Bootstrap authorization: farm.bot@holualoa.k12.hi.us - https://my.farm.bot -1, -1, -1 Apr 12, 1:34pm
Busy Beginning Bootstrap authorization: farm.bot@holualoa.k12.hi.us - https://my.farm.bot -1, -1, -1 Apr 12, 1:34pm
Debug FarmBot Server not configured yet. Waiting 10_000 ms to try OTA config again. -1, -1, -1 Apr 12, 1:34pm
Success DNS resolution successful -1, -1, -1 Apr 12, 1:34pm
Debug Ip address: 10.150.137.222 -1, -1, -1 Apr 12, 1:34pm
Debug Hacking tzdata. -1, -1, -1 Apr 12, 1:34pm
Success Interface eth0 is up. -1, -1, -1 Apr 12, 1:34pm
Busy Waiting for interface eth0 up. -1, -1, -1 Apr 12, 1:34pm
Info Starting Networking -1, -1, -1 Apr 12, 1:34pm
Busy Configuring Farmbot. -1, -1, -1 Apr 12, 1:34pm
Success detected target UART: /dev/ttyACM0 -1, -1, -1 Apr 12, 1:34pm
Busy Checking /root/boot -1, -1, -1 Apr 12, 1:34pm
Debug Loading kernel module: snd-bcm2835 -1, -1, -1 Apr 12, 1:34pm
Busy Initializing Firmware. -1, -1, -1 Apr 12, 1:34pm
Busy Firmware not initialized yet. Waiting for R88 message. -1, -1, -1 Apr 12, 1:34pm
Warn Firmware is being stubbed. -1, -1, -1 Apr 12, 1:34pm
Debug Ensuring /tmp/images/ exists. -1, -1, -1 Apr 12, 1:34pm
Success Successful Bootstrap authorization: farm.bot@holualoa.k12.hi.us - https://my.farm.bot -1, -1, -1 Apr 12, 1:34pm
Busy Beginning Bootstrap authorization: farm.bot@holualoa.k12.hi.us - https://my.farm.bot -1, -1, -1 Apr 12, 1:34pm
Busy Initializing Firmware. -1, -1, -1 Apr 12, 1:34pm
Busy Firmware not initialized yet. Waiting for R88 message. -1, -1, -1 Apr 12, 1:34pm
Warn Firmware is being stubbed. -1, -1, -1 Apr 12, 1:34pm
Debug Ensuring /tmp/images/ exists. -1, -1, -1 Apr 12, 1:34pm
Success Successful Bootstrap authorization: farm.bot@holualoa.k12.hi.us - https://my.farm.bot -1, -1, -1 Apr 12, 1:34pm
Busy Beginning Bootstrap authorization: farm.bot@holualoa.k12.hi.us - https://my.farm.bot -1, -1, -1 Apr 12, 1:34pm
Busy Initializing Firmware. -1, -1, -1 Apr 12, 1:34pm
Busy Firmware not initialized yet. Waiting for R88 message. -1, -1, -1 Apr 12, 1:34pm
Warn Firmware is being stubbed. -1, -1, -1 Apr 12, 1:34pm
Debug Ensuring /tmp/images/ exists. -1, -1, -1 Apr 12, 1:34pm
Success Successful Bootstrap authorization: farm.bot@holualoa.k12.hi.us - https://my.farm.bot -1, -1, -1 Apr 12, 1:34pm
Busy Beginning Bootstrap authorization: farm.bot@holualoa.k12.hi.us - https://my.farm.bot -1, -1, -1 Apr 12, 1:33pm
Busy Initializing Firmware. -1, -1, -1 Apr 12, 1:33pm
Busy Firmware not initialized yet. Waiting for R88 message. -1, -1, -1 Apr 12, 1:33pm
Warn Firmware is being stubbed. -1, -1, -1 Apr 12, 1:33pm
Debug Ensuring /tmp/images/ exists. -1, -1, -1 Apr 12, 1:33pm
Success Successful Bootstrap authorization: farm.bot@holualoa.k12.hi.us - https://my.farm.bot -1, -1, -1 Apr 12, 1:33pm
Busy Beginning Bootstrap authorization: farm.bot@holualoa.k12.hi.us - https://my.farm.bot -1, -1, -1 Apr 12, 1:33pm
Error Token Refresh failed: {{:badmatch, {:error, {:shutdown, {:failed_to_start_child, Farmbot.BotState.Transport.HTTP, :noproc}}}}, [{Farmbot.Bootstrap.AuthTask, :restart_transports, 0, [file: 'lib/farmbot/bootstrap/auth_task.ex', line: 80]}, {Farmbot.Bootstrap.AuthTask, :do_refresh, 0, [file: 'lib/farmbot/bootstrap/auth_task.ex', line: 47]}, {:gen_server, :try_dispatch, 4, [file: 'gen_server.erl', line: 637]}, {:gen_server, :handle_msg, 6, [file: 'gen_server.erl', line: 711]}, {:proc_lib, :wake_up, 3, [file: 'proc_lib.erl', line: 259]}]} -1, -1, -1 Apr 12, 1:33pm
Busy Initializing Firmware. -1, -1, -1 Apr 12, 1:33pm
Busy Firmware not initialized yet. Waiting for R88 message. -1, -1, -1 Apr 12, 1:33pm
Warn CeleryScript: #PID<0.5016.0> died: {:shutdown, {GenServer, :call, [Farmbot.Repo.Worker, {:sync, [1, 90000]}, 91500]}} 0, 0, 0 Apr 12, 1:33pm
Debug Pin Binding Button 1 registered. 0, 0, 0 Apr 12, 1:33pm
Debug Pin Binding Button 2 registered. 0, 0, 0 Apr 12, 1:33pm
Debug HTTP requests took: 2864655us. 0, 0, 0 Apr 12, 1:33pm
Debug Starting HTTP requests. 0, 0, 0 Apr 12, 1:33pm
Busy Syncing 0, 0, 0 Apr 12, 1:33pm

Farmbot is offline and remains that way.


#25

same experience in my case - could control farmbot with manual movements immediately after startup with 7.0.3, after pressing sync it would appear as disconnected in the app and remain that way ever since.


#26

@eide @Holualoa_School Thanks for these updates- I’m in the process of debugging. We have a hunch it’s related to dropped packets but are still investigating. I will keep you posted. Thanks for everyone who has provided us debug information and sorry for the downtime this has caused.


#27

@RickCarlino thanks, i am near my farmbot for around 12 more hours so in case you need more assistance with debugging let me know :slight_smile:


#28

I flashed the 7.0.3 firmware, but I still have the same errors:

Busy Initializing Firmware. -1, -1, -1 Apr 13, 2:00pm
2

Success|Successful Bootstrap authorization: .com - https://my.farm.bot|-1, -1, -1|Apr 13, 2:00pm|
|2

Busy|Beginning Bootstrap authorization: .com - https://my.farm.bot|-1, -1, -1|Apr 13, 2:00pm|
|1

Busy|Initializing Firmware.|-1, -1, -1|Apr 13, 2:00pm|
|1

Busy|Initializing Firmware.|-1, -1, -1|Apr 13, 2:00pm|
|2

Success|Successful Bootstrap authorization: .com - https://my.farm.bot|-1, -1, -1|Apr 13, 2:00pm|
|2

Busy|Beginning Bootstrap authorization: - https://my.farm.bot|-1, -1, -1|Apr 13, 2:00pm|
|1

Busy|Initializing Firmware.|-1, -1, -1|Apr 13, 1:59pm|
|2

Success|Successful Bootstrap authorization: - https://my.farm.bot|-1, -1, -1|Apr 13, 1:59pm|
|2

Busy|Beginning Bootstrap authorization: com - https://my.farm.bot|-1, -1, -1|Apr 13, 1:59pm|
|1

Busy|Initializing Firmware.|-1, -1, -1|Apr 13, 1:59pm|
|2

Success|Successful Bootstrap authorization: .com - https://my.farm.bot|-1, -1, -1|Apr 13, 1:59pm|
|2

Busy|Beginning Bootstrap authorization: .com - https://my.farm.bot|-1, -1, -1|Apr 13, 1:59pm|
|1

Busy|Initializing Firmware.|-1, -1, -1|Apr 13, 1:59pm|
|2

Success|Successful Bootstrap authorization: com - https://my.farm.bot|-1, -1, -1|Apr 13, 1:59pm|
|2

Busy|Beginning Bootstrap authorization: .com - https://my.farm.bot|-1, -1, -1|Apr 13, 1:59pm|
|1

Busy|Initializing Firmware.|-1, -1, -1|Apr 13, 1:59pm|
|1

Debug|Synced Farmbot OS and Firmware settings with API|-1, -1, -1|Apr 13, 1:59pm|
|1

Error|Farmevent checkup process died: {%ArgumentError{message: “repo Farmbot.Repo is not started, please ensure it is part of your supervision tree”}, [{Ecto.Query.Planner, :query_lookup, 6, [file: ‘lib/ecto/query/planner.ex’, line: 148]}, {Ecto.Query.Planner, :query_with_cache, 7, [file: ‘lib/ecto/query/planner.ex’, line: 131]}, {Ecto.Repo.Queryable, :execute, 5, [file: ‘lib/ecto/repo/queryable.ex’, line: 124]}, {Ecto.Repo.Queryable, :all, 4, [file: ‘lib/ecto/repo/queryable.ex’, line: 37]}, {Ecto.Repo.Queryable, :one, 4, [file: ‘lib/ecto/repo/queryable.ex’, line: 70]}, {Farmbot.Asset, :get_sequence_by_id!, 1, [file: ‘lib/farmbot/asset/asset.ex’, line: 71]}, {Farmbot.FarmEvent.Manager, :check_event, 3, [file: ‘lib/farmbot/farm_event/manager.ex’, line: 206]}, {Farmbot.FarmEvent.Manager, :do_checkup, 4, [file: ‘lib/farmbot/farm_event/manager.ex’, line: 179]}]}|


#29

Just adding my observations to this thread in case it helps . . Pin Bindings are established when SYNC is actioned first time. Yesterday I had a log loop (at the WebApp end) which looked a lot like examples earlier in this thread but my raw RingLogger output was full of red crash traces (ALE handler) because my bot has nothing at all connected to its GPIO pins.

The other thing since booting up on 7.0.3 is that I’m sometimes seeing the following AMQP-related messages I’ve not had before. (My bot is connected to my.farm.bot as Farmbot-f390).
I wonder whether Melbourne/Australia is just too far from the US West Coast (packet transit-wise) ?

I’ll try some debugging on this.


(more . . and 3 more pages of Farmbot is up and running!)


#30

@jsimmonds We’re still investigating but at this point, I am suspicious that it is the RabbitMQ library or a configuration thereof.

There were some timeout related errors earlier / yesterday, and removing the heartbeat from AMQP entirely did not seem to help. Furthermore, API-related services (such as background workers) that use AMQP (but not the same AMQP client as FBOS, because the API is a Ruby app) do not suffer from the issue, leading me to believe it is not a server-related config issue and strengthening the argument that it is either client related or FBOS configuration related.


#31

Hi there, I’m being stung by this, and have for the last couple days since I upgraded from 7.01. I’ve installed 7.01 again multiple times - but without fail OTA updates seem to happen. The web UI has them disabled, but as soon as it boots happily (I can interact just fine), it OTAs to 7.03 and doesn’t work.

FYI - this is Ethernet hardwire, that has worked for quite some time.

Am I missing some step to turning of OTA, other than the switch?


#32

Thanks @RickCarlino . . I suspect there is a Pin Binding bug also “stirring trouble” here :slight_smile:

It would explain why (after first SYNC) that people are unable to ever get their FBOS back online despite cold re-booting, and also gives that repeating log cycle at the WebApp end.

From my serial console just now :


#33

@RickCarlino Finally got back to 7.01 and it’s working great again.

For folks who need to stay on 7.01, you have to have logs up after it starts fresh.

The device will kick OTA before it even tries to sync down settings. The trick is to pull the power about 3-5 seconds after you see that it has downloaded the new config from the server, and before OTA completes.

Booting back up, keeps you in 7.01 - and you’re sitting pretty.


#34

we’ve temporarily reset the latest update to 7.0.1 again while we further investigate.


#35

Flashing to 7.0.1 works for me.

Also, can you confirm that the with the “Farmbot OS Auto Update” set to “No”, we won’t get updated. (I don’t want to move to a newer version until I’m sure it works. Losing functionality of the farmbot is inconvenient)


#36

I can also confirm that re-installing FBOS 7.0.1 now returns Farmbot to a stable state. Mahalo!


#37

Pin Binding is sane again on 7.0.1 :slight_smile:


#38

I am trying now getting my one work with 7.0.1. basic execution of sequences, synchronization works. however it will take me a while to fine tune it, because of some unexpected changes I noticed so far:

  1. some of the device settings (max speed, min speed, accelerate for, and encoders for positioning set to off) were changed. not sure if this was due to multiple OS re flashing attempts, or due to the fact that farmbot was appearing as disconnected for around 5days
  2. 3rd party farmware was uninstalled (i use MLH package for watering / planting)
  3. I get this message too often “Device is sending too many logs (more than 500 logs in 1 minute). Suspending log storage and display until 09:26AM” it would not resume logging even after the cool down period. Also it would report too many logs even with the “normal” log filtering set.

#39

@eide, Do you have Firmware Logs turned on (in Logging Settings) ?


#40

yes, I had then on, so I just have turned them off :slight_smile: