Manually set state breaks return value of FutureProvider and AsyncNotifierProvider

[trejdych]

Describe the bug
When I manually set a state in a FutureProvider or AsyncNotifier build method the returned value is ignored. The problem exists for both syntaxes.
so for the someProvider (from the snippet below), I got the states:

1. AsyncLoading()
2. AsyncData(value:1)
3. AsyncData(value:2)

To Reproduce

import 'package:flutter/material.dart';
import 'package:flutter_riverpod/flutter_riverpod.dart';

final someProvider = FutureProvider<int>((ref) async {
  await Future.delayed(const Duration(seconds: 1));
  ref.state = const AsyncData(1);
  await Future.delayed(const Duration(seconds: 1));
  ref.state = const AsyncData(2);
  await Future.delayed(const Duration(seconds: 1));
  return 3;
});

void main() {
  runApp(const ProviderScope(child: MyApp()));
}

class MyApp extends ConsumerWidget {
  const MyApp({super.key});

  @override
  Widget build(BuildContext context, WidgetRef ref) {
    return MaterialApp(
      home: Scaffold(
        body: Column(
          mainAxisAlignment: MainAxisAlignment.center,
          children: [
            Text(
              ref.watch(someProvider).toString(),
            ),
            TextButton(
              onPressed: () => ref.invalidate(someProvider),
              child: const Text('invalidate'),
            ),
          ],
        ),
      ),
    );
  }
}

environment:

Flutter 3.3.9
flutter_riverpod: 2.1.1

Expected behavior
The returned value should also be set as the provider's state.
So the result should be

1. AsyncLoading()
2. AsyncData(value:1)
3. AsyncData(value:2)
4. AsyncData(value:3)