[Systems] git.sugarlabs.org failing

James Cameron quozl at laptop.org
Sat Feb 4 19:18:26 EST 2023


Thanks.

I've looked at the filesystem.  The MySQL (mariaDB) server was not
running.  This outage began on 31st July 2022.  Apache logs contain
500 type errors for all gitorious URIs.  Most traffic appears to be
bots.  I've seen nothing in mail to suggest MySQL should not be
running.  I've started it again.  I've checked git.sugarlabs.org
responds correctly.

My guess is that it failed and nobody noticed for about 272100
minutes.

The system is running Ubuntu 12.04.5.

Let me know when you've finished with it, and I'll turn MySQL back off.

References:

/etc/apache2/sites-available/git.sugarlabs.org
/srv/gitorious/app/public
/var/log/apache2/git.sugarlabs.org.log '500s back to 2022-12-15
/var/log/mysql last change 2022-07-31
/var/lib/mysql/gitorious/users.ibd last change 2022-07-31

On Sat, Feb 04, 2023 at 04:32:23PM -0500, Frederick Grose wrote:
> This appears after a long delay at git.sugarlabs.or
> 
> Ruby on Rails application could not be started
> 
> There appears to be a database problem.
> 
>   • Your config/database.yml may not be written correctly. Please check it and
>     fix any errors.
>   • Your database schema may be out of date or nonexistant. Please run rake
>     db:migrate to ensure that the database schema is up-to-date.
>   • The database server may not be running. Please check whether it's running,
>     and start it if it isn't.
> 
> Error message:
>     Can't connect to local MySQL server through socket '/var/run/mysqld/
>     mysqld.sock' (111 "Connection refused") (Mysql::Error)
> Exception class:
>     Mysql::Error
> Application root:
>     /srv/gitorious/app
> Backtrace:
> 
>     #                    File                   Line          Location
>        /var/lib/gems/1.8/gems/
>     0  activerecord-2.3.18/lib/active_record/   620  in `real_connect'
>        connection_adapters/mysql_adapter.rb
>        /var/lib/gems/1.8/gems/
>     1  activerecord-2.3.18/lib/active_record/   620  in `connect'
>        connection_adapters/mysql_adapter.rb
>        /var/lib/gems/1.8/gems/
>     2  activerecord-2.3.18/lib/active_record/   203  in `initialize'
>        connection_adapters/mysql_adapter.rb
>        /var/lib/gems/1.8/gems/
>     3  activerecord-2.3.18/lib/active_record/   75   in `new'
>        connection_adapters/mysql_adapter.rb
>        /var/lib/gems/1.8/gems/
>     4  activerecord-2.3.18/lib/active_record/   75   in `mysql_connection'
>        connection_adapters/mysql_adapter.rb
>        /var/lib/gems/1.8/gems/
>     5  activerecord-2.3.18/lib/active_record/   223  in `send'
>        connection_adapters/abstract/
>        connection_pool.rb
>        /var/lib/gems/1.8/gems/
>     6  activerecord-2.3.18/lib/active_record/   223  in `new_connection'
>        connection_adapters/abstract/
>        connection_pool.rb
>        /var/lib/gems/1.8/gems/
>     7  activerecord-2.3.18/lib/active_record/   245  in
>        connection_adapters/abstract/                 `checkout_new_connection'
>        connection_pool.rb
>        /var/lib/gems/1.8/gems/
>     8  activerecord-2.3.18/lib/active_record/   188  in `checkout'
>        connection_adapters/abstract/
>        connection_pool.rb
>        /var/lib/gems/1.8/gems/
>     9  activerecord-2.3.18/lib/active_record/   184  in `loop'
>        connection_adapters/abstract/
>        connection_pool.rb
>        /var/lib/gems/1.8/gems/
>     10 activerecord-2.3.18/lib/active_record/   184  in `checkout'
>        connection_adapters/abstract/
>        connection_pool.rb
>     11 /usr/lib/ruby/1.8/monitor.rb             242  in `synchronize'
>        /var/lib/gems/1.8/gems/
>     12 activerecord-2.3.18/lib/active_record/   183  in `checkout'
>        connection_adapters/abstract/
>        connection_pool.rb
>        /var/lib/gems/1.8/gems/
>     13 activerecord-2.3.18/lib/active_record/   98   in `connection'
>        connection_adapters/abstract/
>        connection_pool.rb
>        /var/lib/gems/1.8/gems/
>     14 activerecord-2.3.18/lib/active_record/   326  in `retrieve_connection'
>        connection_adapters/abstract/
>        connection_pool.rb
>        /var/lib/gems/1.8/gems/
>     15 activerecord-2.3.18/lib/active_record/   123  in `retrieve_connection'
>        connection_adapters/abstract/
>        connection_specification.rb
>        /var/lib/gems/1.8/gems/
>     16 activerecord-2.3.18/lib/active_record/   115  in `connection'
>        connection_adapters/abstract/
>        connection_specification.rb
>        /var/lib/gems/1.8/gems/
>     17 activerecord-2.3.18/lib/active_record/   1299 in `table_exists?'
>        base.rb
>        /var/lib/gems/1.8/gems/
>     18 acts-as-taggable-on-2.0.6/lib/           5    in `included'
>        acts_as_taggable_on/acts_as_taggable_on/
>        cache.rb
>        /var/lib/gems/1.8/gems/
>     19 acts-as-taggable-on-2.0.6/lib/           46   in `include'
>        acts_as_taggable_on/
>        acts_as_taggable_on.rb
>        /var/lib/gems/1.8/gems/
>     20 acts-as-taggable-on-2.0.6/lib/           46   in `acts_as_taggable_on'
>        acts_as_taggable_on/
>        acts_as_taggable_on.rb
>        /var/lib/gems/1.8/gems/
>     21 acts-as-taggable-on-2.0.6/lib/           36   in `class_eval'
>        acts_as_taggable_on/
>        acts_as_taggable_on.rb
>        /var/lib/gems/1.8/gems/
>     22 acts-as-taggable-on-2.0.6/lib/           36   in `acts_as_taggable_on'
>        acts_as_taggable_on/
>        acts_as_taggable_on.rb
>        /var/lib/gems/1.8/gems/
>     23 acts-as-taggable-on-2.0.6/lib/           15   in `acts_as_taggable'
>        acts_as_taggable_on/
>        acts_as_taggable_on.rb
>     24 /srv/gitorious/app/app/models/project.rb 28
>        /var/lib/gems/1.8/gems/
>     25 activesupport-2.3.18/lib/active_support/ 184  in `require'
>        dependencies.rb
>        /var/lib/gems/1.8/gems/
>     26 activesupport-2.3.18/lib/active_support/ 184  in `require'
>        dependencies.rb
>        /var/lib/gems/1.8/gems/
>     27 activesupport-2.3.18/lib/active_support/ 291  in `require_or_load'
>        dependencies.rb
>        /var/lib/gems/1.8/gems/
>     28 activesupport-2.3.18/lib/active_support/ 451  in `load_missing_constant'
>        dependencies.rb
>        /var/lib/gems/1.8/gems/
>     29 activesupport-2.3.18/lib/active_support/ 106  in `const_missing'
>        dependencies.rb
>        /var/lib/gems/1.8/gems/
>     30 activesupport-2.3.18/lib/active_support/ 118  in `const_missing'
>        dependencies.rb
>        /var/lib/gems/1.8/gems/
>     31 activesupport-2.3.18/lib/active_support/ 463  in `load_missing_constant'
>        dependencies.rb
>        /var/lib/gems/1.8/gems/
>     32 activesupport-2.3.18/lib/active_support/ 106  in `const_missing'
>        dependencies.rb
>        /var/lib/gems/1.8/gems/
>     33 activesupport-2.3.18/lib/active_support/ 463  in `load_missing_constant'
>        dependencies.rb
>        /var/lib/gems/1.8/gems/
>     34 activesupport-2.3.18/lib/active_support/ 106  in `const_missing'
>        dependencies.rb
>     35 /srv/gitorious/app/lib/gitorious/        24   in `setup'
>        search_index.rb
>     36 /srv/gitorious/app/config/environment.rb 94
>     37 /var/lib/gems/1.8/gems/rails-2.3.18/lib/ 614  in `call'
>        initializer.rb
>     38 /var/lib/gems/1.8/gems/rails-2.3.18/lib/ 614  in `after_initialize'
>        initializer.rb
>     39 /var/lib/gems/1.8/gems/rails-2.3.18/lib/ 613  in `each'
>        initializer.rb
>     40 /var/lib/gems/1.8/gems/rails-2.3.18/lib/ 613  in `after_initialize'
>        initializer.rb
>     41 /var/lib/gems/1.8/gems/rails-2.3.18/lib/ 179  in `process'
>        initializer.rb
>     42 /var/lib/gems/1.8/gems/rails-2.3.18/lib/ 113  in `send'
>        initializer.rb
>     43 /var/lib/gems/1.8/gems/rails-2.3.18/lib/ 113  in `run'
>        initializer.rb
>     44 /srv/gitorious/app/config/environment.rb 23
>     45 /usr/lib/ruby/1.8/phusion_passenger/     222  in `require'
>        classic_rails/application_spawner.rb
>     46 /usr/lib/ruby/1.8/phusion_passenger/     222  in `preload_application'
>        classic_rails/application_spawner.rb
>     47 /usr/lib/ruby/1.8/phusion_passenger/     181  in `initialize_server'
>        classic_rails/application_spawner.rb
>     48 /usr/lib/ruby/1.8/phusion_passenger/     563  in
>        utils.rb                                      `report_app_init_status'
>     49 /usr/lib/ruby/1.8/phusion_passenger/     174  in `initialize_server'
>        classic_rails/application_spawner.rb
>     50 /usr/lib/ruby/1.8/phusion_passenger/     204  in `start_synchronously'
>        abstract_server.rb
>     51 /usr/lib/ruby/1.8/phusion_passenger/     180  in `start'
>        abstract_server.rb
>     52 /usr/lib/ruby/1.8/phusion_passenger/     149  in `start'
>        classic_rails/application_spawner.rb
>     53 /usr/lib/ruby/1.8/phusion_passenger/     219  in
>        spawn_manager.rb                              `spawn_rails_application'
>     54 /usr/lib/ruby/1.8/phusion_passenger/     132  in `lookup_or_add'
>        abstract_server_collection.rb
>     55 /usr/lib/ruby/1.8/phusion_passenger/     214  in
>        spawn_manager.rb                              `spawn_rails_application'
>     56 /usr/lib/ruby/1.8/phusion_passenger/     82   in `synchronize'
>        abstract_server_collection.rb
>     57 /usr/lib/ruby/1.8/phusion_passenger/     79   in `synchronize'
>        abstract_server_collection.rb
>     58 /usr/lib/ruby/1.8/phusion_passenger/     213  in
>        spawn_manager.rb                              `spawn_rails_application'
>     59 /usr/lib/ruby/1.8/phusion_passenger/     132  in `spawn_application'
>        spawn_manager.rb
>     60 /usr/lib/ruby/1.8/phusion_passenger/     275  in
>        spawn_manager.rb                              `handle_spawn_application'
>     61 /usr/lib/ruby/1.8/phusion_passenger/     357  in `__send__'
>        abstract_server.rb
>     62 /usr/lib/ruby/1.8/phusion_passenger/     357  in `server_main_loop'
>        abstract_server.rb
>     63 /usr/lib/ruby/1.8/phusion_passenger/     206  in `start_synchronously'
>        abstract_server.rb
>     64 /usr/share/phusion-passenger/            99
>        helper-scripts/passenger-spawn-server
> 
> Powered by [1]Phusion Passenger, mod_rails / mod_rack for Apache and Nginx.
> 
> References:
> 
> [1] https://www.phusionpassenger.com/

> _______________________________________________
> Systems mailing list
> Systems at lists.sugarlabs.org
> http://lists.sugarlabs.org/listinfo/systems



More information about the Systems mailing list