智能双录质检 iOS屏幕共享使用说明

本文档详细说明iOS12+的屏幕共享使用方法。

屏幕流获取

1、在项目中添加Targets

targets

2、添加Broadcast Upload Extension—->Next

添加Broadcast Upload Extension

3、在你想要实现屏幕共享的界面添加调取方法

  
   #import "ViewController.h"
   #import <ReplayKit/ReplayKit.h>
   
   #define TAG_SHARESCREEN 10086
   
   @interface ViewController ()
   @property (nonatomic, strong) RPSystemBroadcastPickerView*broadPickerView;
   @end
   
   @implementation ViewController
   
   - (void)viewDidLoad {
    [super viewDidLoad];
    // Do any additional setup after loading the view.
    _broadPickerView = [[RPSystemBroadcastPickerView alloc] initWithFrame:CGRectMake(50, 50, 200, 200)];
    _broadPickerView.preferredExtension = @"此处填写你创建的Broadcast Upload Extension 的Bundle id（不是SetupUI的那个）";
    [self.view addSubview:_broadPickerView];
   }
   @end

运行点击屏幕上的按钮便调取出来了开始录屏的界面

根据需求：可能不想要系统自带的按钮，可以做以下优化：

  
   #import "ViewController.h"
   #import <ReplayKit/ReplayKit.h>
   
   #define TAG_SHARESCREEN 10086
   
   @interface ViewController ()
   @property (nonatomic, strong) RPSystemBroadcastPickerView*broadPickerView;
   @end
   
   @implementation ViewController
   
   - (void)viewDidLoad {
    [super viewDidLoad];
    // Do any additional setup after loading the view.
   
    _broadPickerView = [[RPSystemBroadcastPickerView alloc] initWithFrame:CGRectMake(50, 50, 200, 200)];
    _broadPickerView.preferredExtension = @"此处填写你创建的Broadcast Upload Extension 的Bundle id（不是SetupUI的那个）";
   
    UIButton *button = [[UIButton alloc] initWithFrame:CGRectMake(50, 50, 300, 40)];
    [button setTitle:@"点我就好了" forState:UIControlStateNormal];
    [button addTarget:self action:@selector(clickedOnStartRecordButton:) forControlEvents:UIControlEventTouchUpInside];
    [button setTitleColor:[UIColor redColor] forState:UIControlStateNormal];
    button.tag = TAG_SHARESCREEN;
    [self.view addSubview:button];
   }
   - (void)clickedOnStartRecordButton:(UIButton *)sender
   {
    if (sender.tag == TAG_SHARESCREEN)
    {
    for (UIView *view in _broadPickerView.subviews)
    {
    if ([view isKindOfClass:[UIButton class]])
    {
    //调起录像方法，UIControlEventTouchUpInside的方法看其他文章用的是UIControlEventTouchDown，
    //我使用时用UIControlEventTouchUpInside用好使，看个人情况决定
    [(UIButton*)view sendActionsForControlEvents:UIControlEventTouchUpInside];
    }
    }
    }
   }
   
   @end

调试：

1、先运行项目(demo)到手机上

例：demo

运行项目

此时操作录屏等操作，只能断点到demo里的代码

2、检测IDRS_Demo中的数据

检测IDRS_Demo中的数据：运行IDRS_Demo 选择上述的项目

选择项目匹配:

选择与哪个项目匹配此时可断点到 IDRS_Demo 下的所有代码

3、检测IDRS_DemoSetupUI：

检测IDRS_DemoSetupUI：运行IDRS_DemoSetupUI选择上述的项目（这个地方没有用到）

此时可断点到 IDRS_DemoSetupUI 下的所有代码

同步数据

把IDRS_Demo获取的屏幕流推送给demo(主App)，demo(主App)推送屏幕流给RTC

简述方法实现

Socket实现数据同步：

1、使用了Socket和Codec两个文件夹中的代码，把两个文件夹拖入自己的主App中。
2、SampleHandler中使用时，需要关联主App加载的代码，方法如下：

详细的使用方法

1、实现获取屏幕流

SampleHandler.m中实现，使用socket发送

  
   #import "SampleHandler.h"
   #import "IDRSClientSocket.h"
   @interface SampleHandler()
   @property(nonatomic , strong)IDRSClientSocket *clientSocket;
   @end

监听开始

  
   - (void)broadcastStartedWithSetupInfo:(NSDictionary<NSString *,NSObject *> *)setupInfo {
    // User has requested to start the broadcast. Setup info from the UI extension can be supplied but optional.
    self.clientSocket = [[IDRSClientSocket alloc] init];
    [self.clientSocket createCliectSocket];
    [self sendStringData:@"初始化"];
   }

监听结束

  
   - (void)broadcastFinished {
    // User has requested to finish the broadcast.
    [self sendStringData:@"停止"];
    [_clientSocket close];
   }

监听数据流

  
   - (void)processSampleBuffer:(CMSampleBufferRef)sampleBuffer withType:(RPSampleBufferType)sampleBufferType {
    //监听数据回流：
    switch (sampleBufferType) {
    case RPSampleBufferTypeVideo:
    // Handle video sample buffer
    [self sendData:sampleBuffer];
    break;
    case RPSampleBufferTypeAudioApp:
    // Handle audio sample buffer for app audio
    //音频流信息：44100，双声道，16bit
    break;
    case RPSampleBufferTypeAudioMic:
    // Handle audio sample buffer for mic audio
    //音频流信息：48000，单声道，16bit
    break;
    default:
    break;
    }
   }

具体发送信息方法

  
   //数据流推送
   - (void)sendData:(CMSampleBufferRef)sampleBuffer{
    [self.clientSocket encodeBuffer:sampleBuffer];
   }
   //文字推送
   -(void)sendStringData:(NSString*)string{
    [self.clientSocket encodeStringBuffer:string];
   }

2、实现socket接受

  
   #import "ViewController.h"
   #import <ReplayKit/ReplayKit.h>
   #import "IDRSServerSocket.h"
   @interface ViewController ()<IDRSServerSocketProtocol>
   @property (nonatomic, strong) RPSystemBroadcastPickerView*broadPickerView;
   @property(nonatomic , strong)IDRSServerSocket *serverSocket;
   @end

初始化socket

  
   - (void)viewDidLoad {
    [super viewDidLoad];
    // Do any additional setup after loading the view.
    [self.serverSocket createServerSocket];
   }

  
   -(IDRSServerSocket *)serverSocket{
    if (!_serverSocket) {
    IDRSServerSocket *socket = [[IDRSServerSocket alloc] init];
    socket.delegate = self;
   
    _serverSocket = socket;
    }
    return _serverSocket;
   }

接收信息

  
   -(void)didProcessSampleBuffer:(CMSampleBufferRef)sampleBuffer{
    //把数据推送给aliRTC
    [self screenStreaming:sampleBuffer];
   
   }
   -(void)didGetStringBuffer:(NSString *)string{
    if ([string isEqualToString:@"初始化"]) {
   
    }else if ([string isEqualToString:@"停止"]){
    //更换本地预览视图，断开socket连接
    isVideoTrue = true;
    [self.engine setExternalVideoSource:NO useTexture:NO sourceType:AliRtcVideosourceCameraLargeType renderMode:AliRtcRenderModeAuto];
    [self.engine startPreview];
    [self.serverSocket disconnect];
    }
   }

3、屏幕流推给aliRTC

aliRTC外部视频输入接口

  
   -(void)screenStreaming:(CMSampleBufferRef)sampleBuffer{
    if (isVideoTrue) {
    isVideoTrue = false;
    [self.engine setLocalViewConfig:nil forTrack:AliRtcVideoTrackCamera];
    [self.engine setExternalVideoSource:YES useTexture:NO sourceType:AliRtcVideosourceCameraLargeType renderMode:AliRtcRenderModeFill];
    }
   
    CVPixelBufferRef pixelBuffer = (CVPixelBufferRef)CMSampleBufferGetImageBuffer(sampleBuffer);
    AliRtcVideoDataSample *dataSample = [[AliRtcVideoDataSample alloc] init];
   
    dataSample.pixelBuffer = pixelBuffer;
    dataSample.type = AliRtcBufferType_CVPixelBuffer;
    int ret = 0;
    ret = [self.engine pushExternalVideoFrame:dataSample sourceType:AliRtcVideosourceCameraLargeType];
   }