User data corruption in phpBB3 to WP/Discourse migration

Canapin · June 7, 2023, 3:57pm

Hi Ryan,

You might have a look at these files and see if you can find some useful information:

script/import_scripts/phpbb3/database/database_3_0.rb

96c6e535a


      
                LEFT OUTER JOIN #{@table_prefix}banlist b ON (
                  u.user_id = b.ban_userid AND b.ban_exclude = 0 AND
                  (b.ban_end = 0 OR b.ban_end >= UNIX_TIMESTAMP())
                )
              WHERE u.user_id > #{last_user_id} AND u.user_type != #{Constants::USER_TYPE_IGNORE}
              ORDER BY u.user_id
              LIMIT #{@batch_size}
            SQL
          end
          
          def count_anonymous_users
            count(<<-SQL)
              SELECT COUNT(DISTINCT p.post_username) AS count
              FROM #{@table_prefix}posts p
                JOIN #{@table_prefix}users u ON (p.poster_id = u.user_id)
              WHERE p.post_username <> '' AND u.user_type = #{Constants::USER_TYPE_IGNORE}
            SQL
          end
          
          def fetch_anonymous_users(last_username)
            last_username = escape(last_username)

Also:

github.com/discourse/discourse

script/import_scripts/phpbb3/importer.rb

main


      
                next if user_id_from_imported_user_id(@settings.prefix(row[:user_id]))
                importer.map_user(row)
              rescue => e
                log_error("Failed to map user with ID #{row[:user_id]}", e)
              end
            end
          end
          
          def import_anonymous_users
            puts "", "creating anonymous users"
            total_count = @database.count_anonymous_users
            importer = @importers.user_importer
            last_username = ""
          
            batches do |offset|
              rows, last_username = @database.fetch_anonymous_users(last_username)
              break if rows.size < 1
          
              create_users(rows, total: total_count, offset: offset) do |row|
                next if user_id_from_imported_user_id(@settings.prefix(row[:post_username]))
                importer.map_anonymous_user(row)

And:

github.com/discourse/discourse

script/import_scripts/phpbb3/importers/user_importer.rb

main


      
                  suspend_user(user, row)
                  @avatar_importer.import_avatar(user, row) if row[:user_avatar_type].present?
                end,
            }
          end
          
          def map_anonymous_users_to_import_ids(rows)
            rows.map { |row| @settings.prefix(row[:post_username]) }
          end
          
          def map_anonymous_user(row)
            username = row[:post_username]
          
            {
              id: @settings.prefix(username),
              email: "anonymous_#{SecureRandom.hex}@no-email.invalid",
              username: username,
              name: @settings.username_as_name ? username : "",
              created_at: Time.zone.at(row[:first_post_time]),
              active: true,
              trust_level: TrustLevel[0],

Maybe you can modify this part not to import anonymous users, or find some clue that would lead to your weird issue.

Topic		Replies	Views
phpBB import issue Migration phpbb	1	631	July 3, 2023
phpBB Migration Preparation Migration phpbb	1	504	January 7, 2025
phpBB3 import script improvements Migration phpbb	11	2987	July 19, 2017
Change from phpbb to Discourse Migration phpbb	11	4646	July 25, 2022
Migrate a phpBB3 forum to Discourse Migrating to Discourse how-to	464	109769	September 4, 2025

User data corruption in phpBB3 to WP/Discourse migration

Related topics